commit 8dadef3dccd3d73b19058525897b7efb9c41b7e7 Author: ModelHub XC Date: Sun Aug 16 12:41:13 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: prithivMLmods/GCIRS-Reasoning-1.5B-R1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..53d7257 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bin.* filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zstandard filter=lfs diff=lfs merge=lfs -text +*.tfevents* filter=lfs diff=lfs merge=lfs -text +*.db* filter=lfs diff=lfs merge=lfs -text +*.ark* filter=lfs diff=lfs merge=lfs -text +**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text +**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text +**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.gguf* filter=lfs diff=lfs merge=lfs -text +*.ggml filter=lfs diff=lfs merge=lfs -text +*.llamafile* filter=lfs diff=lfs merge=lfs -text +*.pt2 filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text \ No newline at end of file diff --git a/GCIRS-Reasoning-1.5B-R1.BF16.gguf b/GCIRS-Reasoning-1.5B-R1.BF16.gguf new file mode 100644 index 0000000..cffb62d --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.BF16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:48b25a1b9045fc826ad110f0f0fca136dcd307f8ce67a17eeb1d1b27c87c206d +size 3560415968 diff --git a/GCIRS-Reasoning-1.5B-R1.F16.gguf b/GCIRS-Reasoning-1.5B-R1.F16.gguf new file mode 100644 index 0000000..2534b3d --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75ae2b0363db0715a0ea1c00a087dfb0bac380791001dcbbd3f7a9ffcf5bd3bf +size 3560415968 diff --git a/GCIRS-Reasoning-1.5B-R1.F32.gguf b/GCIRS-Reasoning-1.5B-R1.F32.gguf new file mode 100644 index 0000000..6012670 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.F32.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:241b396df8816270f021cc6227481a83c52e543bf3f94e3387d93415a41054ce +size 7114302176 diff --git a/GCIRS-Reasoning-1.5B-R1.Q2_K.gguf b/GCIRS-Reasoning-1.5B-R1.Q2_K.gguf new file mode 100644 index 0000000..4489ff2 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:434df31d6192830b749210fbd88644cda73092d88bbec31ff7d3d558ac9828b6 +size 752879840 diff --git a/GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf b/GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf new file mode 100644 index 0000000..fae5fb4 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f90b196fd6a3a29344cb23e9e35a216cfb6fe2fde8c9214b67e34fd70327a3a5 +size 980439776 diff --git a/GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf b/GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf new file mode 100644 index 0000000..1aa56d6 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cb8577b091902b29cd5700be550b51af166c43bfd64be1fbccc9a5fbf5dd49d6 +size 924455648 diff --git a/GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf b/GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf new file mode 100644 index 0000000..a524f8b --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4371f2f75e02fc30081a9aff9312e717b68617e67aa7541f0e52943f2407603f +size 861221600 diff --git a/GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf b/GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf new file mode 100644 index 0000000..525ab04 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c9fa219727d579a58dac19198a0a37e8ea6e114026891451bad4d0457540dc16 +size 1117320416 diff --git a/GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf b/GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf new file mode 100644 index 0000000..59b9053 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2b5d0f387c8a2373dcbe7182446352ac0cac4644868e36f8395f907e2b461eb +size 1071584480 diff --git a/GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf b/GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf new file mode 100644 index 0000000..b02fb49 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ad5d1e6e6aff4e41fc134b31d63873b6377f56a715fb0f35ba45881989fa90c6 +size 1285493984 diff --git a/GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf b/GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf new file mode 100644 index 0000000..6efd8f5 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:425e66bb69c6c265daa86d6a407d38769d965c23aef3305764b849a108a6d171 +size 1259173088 diff --git a/GCIRS-Reasoning-1.5B-R1.Q6_K.gguf b/GCIRS-Reasoning-1.5B-R1.Q6_K.gguf new file mode 100644 index 0000000..13c538c --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1b6bcda12e31464393510d4410cc7f6fcff823c64b0809f7081170b18909e39 +size 1464178400 diff --git a/GCIRS-Reasoning-1.5B-R1.Q8_0.gguf b/GCIRS-Reasoning-1.5B-R1.Q8_0.gguf new file mode 100644 index 0000000..18c3616 --- /dev/null +++ b/GCIRS-Reasoning-1.5B-R1.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e624339948eb28a3bdf26fe6b6255904a8b5eb0b03293494f510cb89cfa1655 +size 1894531808 diff --git a/README.md b/README.md new file mode 100644 index 0000000..0924816 --- /dev/null +++ b/README.md @@ -0,0 +1,55 @@ +--- +license: apache-2.0 +language: +- en +base_model: +- prithivMLmods/GCIRS-Reasoning-1.5B-R1 +pipeline_tag: text-generation +library_name: transformers +tags: +- text-generation-inference +- code +- math +- RL +- science +--- + +# **GCIRS-Reasoning-1.5B-R1-GGUF** + +> **GCIRS-Reasoning-1.5B-R1** is a **research-grade reasoning model** fine-tuned from **Qwen2.5-1.5B-Instruct**, focused on **non-fictional reasoning**, **factual consistency**, and **scientific depth**. Trained with reinforcement learning using the **Big Reasoning Traces** dataset from DeepSeek, this model is tailored for complex analytical tasks and scientific rigor in high-stakes or research environments. + + +## Model Files + +| File Name | Format | Size | Precision | Use Case | +|-----------|--------|------|-----------|----------| +| `GCIRS-Reasoning-1.5B-R1.F32.gguf` | GGUF | 7.11 GB | F32 | Highest precision, research use | +| `GCIRS-Reasoning-1.5B-R1.BF16.gguf` | GGUF | 3.56 GB | BF16 | High precision, balanced performance | +| `GCIRS-Reasoning-1.5B-R1.F16.gguf` | GGUF | 3.56 GB | F16 | High precision, memory efficient | +| `GCIRS-Reasoning-1.5B-R1.Q8_0.gguf` | GGUF | 1.89 GB | Q8_0 | Excellent quality, moderate compression | +| `GCIRS-Reasoning-1.5B-R1.Q6_K.gguf` | GGUF | 1.46 GB | Q6_K | Very good quality, good compression | +| `GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf` | GGUF | 1.29 GB | Q5_K_M | Balanced quality/size (recommended) | +| `GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf` | GGUF | 1.26 GB | Q5_K_S | Good quality, smaller size | +| `GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf` | GGUF | 1.12 GB | Q4_K_M | Good balance for most users | +| `GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf` | GGUF | 1.07 GB | Q4_K_S | Decent quality, compact size | +| `GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf` | GGUF | 980 MB | Q3_K_L | Lower quality, very compact | +| `GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf` | GGUF | 924 MB | Q3_K_M | Fast inference, limited quality | +| `GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf` | GGUF | 861 MB | Q3_K_S | Fastest inference, basic quality | +| `GCIRS-Reasoning-1.5B-R1.Q2_K.gguf` | GGUF | 753 MB | Q2_K | Minimal size, experimental use | + +### Quick Selection Guide + +- **For Research/Development**: Use `F32` or `BF16` for maximum accuracy +- **For Production (Recommended)**: Use `Q5_K_M` or `Q6_K` for best quality/performance balance +- **For General Use**: Use `Q4_K_M` or `Q4_K_S` for good performance +- **For Resource-Constrained Environments**: Use `Q3_K_M` or `Q3_K_L` +- **For Edge Devices**: Use `Q2_K` for minimal footprint + +## Quants Usage + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000..abb5987 --- /dev/null +++ b/config.json @@ -0,0 +1,3 @@ +{ + "model_type": "qwen2" +} \ No newline at end of file diff --git a/configuration.json b/configuration.json new file mode 100644 index 0000000..bbeeda1 --- /dev/null +++ b/configuration.json @@ -0,0 +1 @@ +{"framework": "pytorch", "task": "text-generation", "allow_remote": true} \ No newline at end of file