初始化项目,由ModelHub XC社区提供模型
Model: IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-awq-64g-ppl10.41 Source: Original Platform
This commit is contained in:
22
README.md
Normal file
22
README.md
Normal file
@@ -0,0 +1,22 @@
|
||||
---
|
||||
language: en
|
||||
license: apache-2.0
|
||||
library_name: transformers
|
||||
---
|
||||
|
||||
# Quantized Fine-tuned Model: sqft-phi-3.5-mini-instruct-wikitext2-awq-64g-ppl10.41
|
||||
|
||||
- Source Model: [IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-ppl9.78](https://huggingface.co/IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-ppl9.78)
|
||||
- Finetuning Method: NLS
|
||||
- Adapter Version: Heuristic
|
||||
- Quantization: AWQ-INT4 (group size: 64)
|
||||
|
||||
### Evaluation
|
||||
|
||||
```bash
|
||||
CUDA_VISIBLE_DEVICES=$DEVICES lm_eval --model hf --model_args pretrained=IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-awq-64g-ppl10.41,max_length=4096 --tasks wikitext --batch_size auto:4 --output_path result.json
|
||||
```
|
||||
|
||||
## License
|
||||
|
||||
Apache-2.0
|
||||
Reference in New Issue
Block a user