初始化项目,由ModelHub XC社区提供模型
Model: prithivMLmods/GCIRS-Reasoning-1.5B-R1-GGUF Source: Original Platform
This commit is contained in:
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.db* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ark* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gguf* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ggml filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.llamafile* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
3
GCIRS-Reasoning-1.5B-R1.BF16.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.BF16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:48b25a1b9045fc826ad110f0f0fca136dcd307f8ce67a17eeb1d1b27c87c206d
|
||||||
|
size 3560415968
|
||||||
3
GCIRS-Reasoning-1.5B-R1.F16.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:75ae2b0363db0715a0ea1c00a087dfb0bac380791001dcbbd3f7a9ffcf5bd3bf
|
||||||
|
size 3560415968
|
||||||
3
GCIRS-Reasoning-1.5B-R1.F32.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.F32.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:241b396df8816270f021cc6227481a83c52e543bf3f94e3387d93415a41054ce
|
||||||
|
size 7114302176
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q2_K.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:434df31d6192830b749210fbd88644cda73092d88bbec31ff7d3d558ac9828b6
|
||||||
|
size 752879840
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f90b196fd6a3a29344cb23e9e35a216cfb6fe2fde8c9214b67e34fd70327a3a5
|
||||||
|
size 980439776
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cb8577b091902b29cd5700be550b51af166c43bfd64be1fbccc9a5fbf5dd49d6
|
||||||
|
size 924455648
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4371f2f75e02fc30081a9aff9312e717b68617e67aa7541f0e52943f2407603f
|
||||||
|
size 861221600
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c9fa219727d579a58dac19198a0a37e8ea6e114026891451bad4d0457540dc16
|
||||||
|
size 1117320416
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b2b5d0f387c8a2373dcbe7182446352ac0cac4644868e36f8395f907e2b461eb
|
||||||
|
size 1071584480
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ad5d1e6e6aff4e41fc134b31d63873b6377f56a715fb0f35ba45881989fa90c6
|
||||||
|
size 1285493984
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:425e66bb69c6c265daa86d6a407d38769d965c23aef3305764b849a108a6d171
|
||||||
|
size 1259173088
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q6_K.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d1b6bcda12e31464393510d4410cc7f6fcff823c64b0809f7081170b18909e39
|
||||||
|
size 1464178400
|
||||||
3
GCIRS-Reasoning-1.5B-R1.Q8_0.gguf
Normal file
3
GCIRS-Reasoning-1.5B-R1.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4e624339948eb28a3bdf26fe6b6255904a8b5eb0b03293494f510cb89cfa1655
|
||||||
|
size 1894531808
|
||||||
55
README.md
Normal file
55
README.md
Normal file
@@ -0,0 +1,55 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
base_model:
|
||||||
|
- prithivMLmods/GCIRS-Reasoning-1.5B-R1
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: transformers
|
||||||
|
tags:
|
||||||
|
- text-generation-inference
|
||||||
|
- code
|
||||||
|
- math
|
||||||
|
- RL
|
||||||
|
- science
|
||||||
|
---
|
||||||
|
|
||||||
|
# **GCIRS-Reasoning-1.5B-R1-GGUF**
|
||||||
|
|
||||||
|
> **GCIRS-Reasoning-1.5B-R1** is a **research-grade reasoning model** fine-tuned from **Qwen2.5-1.5B-Instruct**, focused on **non-fictional reasoning**, **factual consistency**, and **scientific depth**. Trained with reinforcement learning using the **Big Reasoning Traces** dataset from DeepSeek, this model is tailored for complex analytical tasks and scientific rigor in high-stakes or research environments.
|
||||||
|
|
||||||
|
|
||||||
|
## Model Files
|
||||||
|
|
||||||
|
| File Name | Format | Size | Precision | Use Case |
|
||||||
|
|-----------|--------|------|-----------|----------|
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.F32.gguf` | GGUF | 7.11 GB | F32 | Highest precision, research use |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.BF16.gguf` | GGUF | 3.56 GB | BF16 | High precision, balanced performance |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.F16.gguf` | GGUF | 3.56 GB | F16 | High precision, memory efficient |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q8_0.gguf` | GGUF | 1.89 GB | Q8_0 | Excellent quality, moderate compression |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q6_K.gguf` | GGUF | 1.46 GB | Q6_K | Very good quality, good compression |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf` | GGUF | 1.29 GB | Q5_K_M | Balanced quality/size (recommended) |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf` | GGUF | 1.26 GB | Q5_K_S | Good quality, smaller size |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf` | GGUF | 1.12 GB | Q4_K_M | Good balance for most users |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf` | GGUF | 1.07 GB | Q4_K_S | Decent quality, compact size |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf` | GGUF | 980 MB | Q3_K_L | Lower quality, very compact |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf` | GGUF | 924 MB | Q3_K_M | Fast inference, limited quality |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf` | GGUF | 861 MB | Q3_K_S | Fastest inference, basic quality |
|
||||||
|
| `GCIRS-Reasoning-1.5B-R1.Q2_K.gguf` | GGUF | 753 MB | Q2_K | Minimal size, experimental use |
|
||||||
|
|
||||||
|
### Quick Selection Guide
|
||||||
|
|
||||||
|
- **For Research/Development**: Use `F32` or `BF16` for maximum accuracy
|
||||||
|
- **For Production (Recommended)**: Use `Q5_K_M` or `Q6_K` for best quality/performance balance
|
||||||
|
- **For General Use**: Use `Q4_K_M` or `Q4_K_S` for good performance
|
||||||
|
- **For Resource-Constrained Environments**: Use `Q3_K_M` or `Q3_K_L`
|
||||||
|
- **For Edge Devices**: Use `Q2_K` for minimal footprint
|
||||||
|
|
||||||
|
## Quants Usage
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
3
config.json
Normal file
3
config.json
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
{
|
||||||
|
"model_type": "qwen2"
|
||||||
|
}
|
||||||
1
configuration.json
Normal file
1
configuration.json
Normal file
@@ -0,0 +1 @@
|
|||||||
|
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}
|
||||||
Reference in New Issue
Block a user