初始化项目，由ModelHub XC社区提供模型

Model: ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,41 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-sft-claude-opus-reasoning-unsloth.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-sft-claude-opus-reasoning-unsloth.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-sft-claude-opus-reasoning-unsloth.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-sft-claude-opus-reasoning-unsloth.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-sft-claude-opus-reasoning-unsloth.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-sft-claude-opus-reasoning-unsloth.q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,86 @@
+---
+license: apache-2.0
+language:
+  - en
+library_name: gguf
+pipeline_tag: text-generation
+tags:
+  - gguf
+  - llama.cpp
+  - quantized
+  - qwen3
+  - reasoning
+  - unsloth
+  - text-generation
+base_model: ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth
+datasets:
+  - ermiaazarkhalili/claude-reasoning-distillation
+---
+
+# Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF
+
+GGUF quantizations of [Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth) for **CPU and edge inference** with [llama.cpp](https://github.com/ggerganov/llama.cpp), [Ollama](https://ollama.com), LM Studio, and other GGUF runtimes.
+
+This model is a fine-tune of [Qwen3-4B (Unsloth 4-bit)](https://huggingface.co/unsloth/qwen3-4b-unsloth-bnb-4bit) for **reasoning distillation (chain-of-thought)**, trained with [Unsloth](https://github.com/unslothai/unsloth) on [claude-reasoning-distillation](https://huggingface.co/datasets/ermiaazarkhalili/claude-reasoning-distillation).
+
+- **Full-precision model:** [Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth)
+- **Base model:** [Qwen3-4B (Unsloth 4-bit)](https://huggingface.co/unsloth/qwen3-4b-unsloth-bnb-4bit)
+- **Parameters:** 4B
+
+## Available Quantizations
+
+| Quant | Size | Recommended Use | File |
+|-------|------|-----------------|------|
+| `Q2_K` | 1.67 GB | Smallest, lowest quality — quick tests / very constrained devices | [`qwen3-4b-sft-claude-opus-reasoning-unsloth.q2_k.gguf`](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/blob/main/qwen3-4b-sft-claude-opus-reasoning-unsloth.q2_k.gguf) |
+| `Q3_K_M` | 2.08 GB | Small, acceptable quality | [`qwen3-4b-sft-claude-opus-reasoning-unsloth.q3_k_m.gguf`](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/blob/main/qwen3-4b-sft-claude-opus-reasoning-unsloth.q3_k_m.gguf) |
+| `Q4_K_M` | 2.50 GB | Recommended — best size/quality balance | [`qwen3-4b-sft-claude-opus-reasoning-unsloth.q4_k_m.gguf`](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/blob/main/qwen3-4b-sft-claude-opus-reasoning-unsloth.q4_k_m.gguf) |
+| `Q5_K_M` | 2.89 GB | High quality, larger | [`qwen3-4b-sft-claude-opus-reasoning-unsloth.q5_k_m.gguf`](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/blob/main/qwen3-4b-sft-claude-opus-reasoning-unsloth.q5_k_m.gguf) |
+| `Q6_K` | 3.31 GB | Very high quality, near-fp16 | [`qwen3-4b-sft-claude-opus-reasoning-unsloth.q6_k.gguf`](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/blob/main/qwen3-4b-sft-claude-opus-reasoning-unsloth.q6_k.gguf) |
+| `Q8_0` | 4.28 GB | Near-lossless, largest | [`qwen3-4b-sft-claude-opus-reasoning-unsloth.q8_0.gguf`](https://huggingface.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/blob/main/qwen3-4b-sft-claude-opus-reasoning-unsloth.q8_0.gguf) |
+
+`Q4_K_M` is the recommended default for most users.
+
+## Usage
+
+### Download a single quant
+
+```bash
+pip install -U "huggingface_hub[cli]"
+hf download ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF \
+  --include "*q4_k_m*.gguf" --local-dir ./Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF
+```
+
+### llama.cpp
+
+```bash
+# build: https://github.com/ggerganov/llama.cpp
+./llama-cli -m ./Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF/qwen3-4b-sft-claude-opus-reasoning-unsloth.q2_k.gguf \
+  -p "Solve step by step: What is the sum of the first 10 prime numbers?" -n 512
+```
+
+### Ollama
+
+```bash
+ollama run hf.co/ermiaazarkhalili/Qwen3-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF:Q4_K_M "Solve step by step: What is the sum of the first 10 prime numbers?"
+```
+
+## Training Outcome
+
+| Metric | Value |
+|--------|-------|
+| SLURM Job ID | `36885896` |
+| Runtime | 21m 03s |
+| Final Training Loss | 0.998 |
+| Peak VRAM | 14.01 GB |
+| GPU | H100 80GB HBM3 (MIG 3g.40gb) |
+
+## License
+
+APACHE-2.0 — see the [base model](https://huggingface.co/unsloth/qwen3-4b-unsloth-bnb-4bit) for full terms.
+
+## Acknowledgments
+
+- [Unsloth](https://github.com/unslothai/unsloth) for 2x faster fine-tuning
+- [llama.cpp](https://github.com/ggerganov/llama.cpp) for GGUF quantization
+- Base model developers (unsloth)
+- [Compute Canada / DRAC](https://alliancecan.ca/) for HPC resources

qwen3-4b-sft-claude-opus-reasoning-unsloth.q2_k.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4af1449070ba7a4adcb4b90fc3c84e4039f41d01852a446cc8cb09c914676cb
+size 1669499520

qwen3-4b-sft-claude-opus-reasoning-unsloth.q3_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:98fd5b1964416245c3ff48e00d621569aaee1228d757a37e196d945162eb0366
+size 2075617920

qwen3-4b-sft-claude-opus-reasoning-unsloth.q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0990d4f4e3a227483a1c6824d51c5176e1d0a353a08ae9a693f1c5c05f227c93
+size 2497280640

qwen3-4b-sft-claude-opus-reasoning-unsloth.q5_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c72dfbee3e0094b615279b08e07ab11cad1b975f14e858edd5bf03acb94c271
+size 2889513600

qwen3-4b-sft-claude-opus-reasoning-unsloth.q6_k.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c4c4ef2cd3cec1ef46c7e0fcd9a4a1935623ec75d33ab95f1def59b8fd714ce5
+size 3306261120

qwen3-4b-sft-claude-opus-reasoning-unsloth.q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0b558a63bb4459060bcead1496ebcce40d8b377586a85c8594a0132b0e5234e
+size 4280405120