44 lines
1.3 KiB
Markdown
44 lines
1.3 KiB
Markdown
---
|
||
base_model: unsloth/Qwen3-0.6B-unsloth-bnb-4bit
|
||
tags:
|
||
- text-generation-inference
|
||
- transformers
|
||
- unsloth
|
||
- qwen3
|
||
license: apache-2.0
|
||
language:
|
||
- en
|
||
---
|
||
|
||
# Meet7 0.6B
|
||
|
||
A general-purpose **Non-Reasoning** LoRA fine-tune of Qwen3-0.6B, trained in under 10 minutes on just 600 samples.
|
||
|
||
## Benchmarks
|
||
|
||
<img src="https://cdn-uploads.huggingface.co/production/uploads/6466047a326128fd2c693cfa/orQ3ohtKYkJYoVikUZn4s.png" width="600"/>
|
||
|
||
Scores are `acc_norm`.
|
||
|
||
| Task | Shot | Qwen3-0.6B | Meet7 0.6B | Δ |
|
||
|------|------|:----------:|:----------:|:-:|
|
||
| BoolQ | 0-shot | 0.3798 | 0.5554 | **+17.56%** |
|
||
| ARC Easy | 3-shot | 0.3636 | 0.4394 | **+07.58%** |
|
||
| ARC Challenge | 3-shot | 0.2952 | 0.3456 | **+05.04%** |
|
||
| HellaSwag | 3-shot | 0.3956 | 0.4323 | **+03.67%** |
|
||
| PIQA | 0-shot | 0.6338 | 0.6583 | **+02.45%** |
|
||
| Winogrande | 0-shot | 0.5225 | 0.5201 | −00.24% |
|
||
|
||
## Model Details
|
||
|
||
| | |
|
||
|---|---|
|
||
| **Developed by** | Ma7ee7 |
|
||
| **License** | Apache-2.0 |
|
||
| **Base model** | unsloth/Qwen3-0.6B-unsloth-bnb-4bit |
|
||
| **Training time** | < 10 minutes |
|
||
| **Training samples** | 600 |
|
||
|
||
Trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Hugging Face TRL.
|
||
|
||
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |