初始化项目,由ModelHub XC社区提供模型

Model: espressor/meta-llama.Llama-3.2-3B-Instruct_W4A16
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-10 04:49:16 +08:00
commit c5df6d01f7
9 changed files with 2277 additions and 0 deletions

60
README.md Normal file
View File

@@ -0,0 +1,60 @@
---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- meta-llama/Llama-3.2-3B-Instruct
library_name: transformers
---
## meta-llama/Llama-3.2-3B-Instruct - W4A16 Compression
This is a compressed model using [llmcompressor](https://github.com/vllm-project/llm-compressor).
## Compression Configuration
- Base Model: meta-llama/Llama-3.2-3B-Instruct
- Compression Scheme: W4A16
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 131072
## Sample Output
#### Prompt:
```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
Cutting Knowledge Date: December 2023
Today Date: 28 Nov 2024
<|eot_id|><|start_header_id|>user<|end_header_id|>
Who is Alan Turing?<|eot_id|>
```
#### Output:
```
<|begin_of_text|><|begin_of_text|><|start_header_id|>system<|end_header_id|>
Cutting Knowledge Date: December 2023
Today Date: 28 Nov 2024
<|eot_id|><|start_header_id|>user<|end_header_id|>
Who is Alan Turing?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Alan Turing (1912-1954) was a British mathematician, computer scientist, logician, and philosopher who made significant contributions to the development of computer science, artificial intelligence, and cryptography. He is widely considered one of the most influential figures in the history of computer science.
Early Life and Education:
Turing was born in London, England, on June 23, 1912. He was educated at King's School in Croton, and later at King's College, Cambridge, where he studied mathematics and philosophy. During World War II, Turing worked at the Government Code and Cypher School (GC
```
## Evaluation
<TODO>