初始化项目,由ModelHub XC社区提供模型
Model: prithivMLmods/GCIRS-Reasoning-1.5B-R1-GGUF Source: Original Platform
This commit is contained in:
55
README.md
Normal file
55
README.md
Normal file
@@ -0,0 +1,55 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
base_model:
|
||||
- prithivMLmods/GCIRS-Reasoning-1.5B-R1
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- text-generation-inference
|
||||
- code
|
||||
- math
|
||||
- RL
|
||||
- science
|
||||
---
|
||||
|
||||
# **GCIRS-Reasoning-1.5B-R1-GGUF**
|
||||
|
||||
> **GCIRS-Reasoning-1.5B-R1** is a **research-grade reasoning model** fine-tuned from **Qwen2.5-1.5B-Instruct**, focused on **non-fictional reasoning**, **factual consistency**, and **scientific depth**. Trained with reinforcement learning using the **Big Reasoning Traces** dataset from DeepSeek, this model is tailored for complex analytical tasks and scientific rigor in high-stakes or research environments.
|
||||
|
||||
|
||||
## Model Files
|
||||
|
||||
| File Name | Format | Size | Precision | Use Case |
|
||||
|-----------|--------|------|-----------|----------|
|
||||
| `GCIRS-Reasoning-1.5B-R1.F32.gguf` | GGUF | 7.11 GB | F32 | Highest precision, research use |
|
||||
| `GCIRS-Reasoning-1.5B-R1.BF16.gguf` | GGUF | 3.56 GB | BF16 | High precision, balanced performance |
|
||||
| `GCIRS-Reasoning-1.5B-R1.F16.gguf` | GGUF | 3.56 GB | F16 | High precision, memory efficient |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q8_0.gguf` | GGUF | 1.89 GB | Q8_0 | Excellent quality, moderate compression |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q6_K.gguf` | GGUF | 1.46 GB | Q6_K | Very good quality, good compression |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q5_K_M.gguf` | GGUF | 1.29 GB | Q5_K_M | Balanced quality/size (recommended) |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q5_K_S.gguf` | GGUF | 1.26 GB | Q5_K_S | Good quality, smaller size |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q4_K_M.gguf` | GGUF | 1.12 GB | Q4_K_M | Good balance for most users |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q4_K_S.gguf` | GGUF | 1.07 GB | Q4_K_S | Decent quality, compact size |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q3_K_L.gguf` | GGUF | 980 MB | Q3_K_L | Lower quality, very compact |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q3_K_M.gguf` | GGUF | 924 MB | Q3_K_M | Fast inference, limited quality |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q3_K_S.gguf` | GGUF | 861 MB | Q3_K_S | Fastest inference, basic quality |
|
||||
| `GCIRS-Reasoning-1.5B-R1.Q2_K.gguf` | GGUF | 753 MB | Q2_K | Minimal size, experimental use |
|
||||
|
||||
### Quick Selection Guide
|
||||
|
||||
- **For Research/Development**: Use `F32` or `BF16` for maximum accuracy
|
||||
- **For Production (Recommended)**: Use `Q5_K_M` or `Q6_K` for best quality/performance balance
|
||||
- **For General Use**: Use `Q4_K_M` or `Q4_K_S` for good performance
|
||||
- **For Resource-Constrained Environments**: Use `Q3_K_M` or `Q3_K_L`
|
||||
- **For Edge Devices**: Use `Q2_K` for minimal footprint
|
||||
|
||||
## Quants Usage
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
Reference in New Issue
Block a user