featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-22 16:49:46 +08:00
commit b9fb233576
14 changed files with 130 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
R1pathak-TinyLlama_v1.1_float16_0.0-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
featherless-quants.png filter=lfs diff=lfs merge=lfs -text

3
R1pathak-TinyLlama_v1.1_float16_0.0-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fab1a441f739f409abf2829895b81ca716a69efb92ca0bdc6aa585da05150c03
size 609807264

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:530b6cb1ff4752f4ad1b2e171cc49937879da6bc821f24bc0e0af43151972707
size 432130976

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3cc744c651066db88f5643066fe61509e939491c16b0d74c6a8afd0fd470fec
size 591526816

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0749555d85707e39c4e8942f2a584dc116c34a3f46ba7c5f1509897d1400da22
size 548404128

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2741dfd98609a08c50a9e6782aca6b9effab3012654583130d11ed0d7fffe4fb
size 499342240

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3edcf56eb39ce139c244477cb2a7e40ccbe54bfb8313682b4ab03695c89c18f
size 667814816

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71b408c286d86383896ff37f0d7bee4e66b997e8a7e420b63659b3633a0aa223
size 639871904

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7e81a4be208e1e601800ea588e5b2f8f2a64d3eb41c00d244a4afa418324ecd
size 782044064

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:998c1a103916825da09b36d55b54205c74edf9030303fea0cc6f514546112785
size 766028704

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16c1439f399fc734f5185b6ef3b2209f72f70f12d2d581180e090e8923a513d5
size 903412640

3
R1pathak-TinyLlama_v1.1_float16_0.0-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0238b3d0d24dd3fe8e39baad84ea8c254d4b224534ef9f59857c81e41f39426f
size 1169808288

47
README.md Normal file
View File

@@ -0,0 +1,47 @@
---
base_model: R1pathak/TinyLlama_v1.1_float16_0.0
pipeline_tag: text-generation
quantized_by: featherless-ai-quants
---
# R1pathak/TinyLlama_v1.1_float16_0.0 GGUF Quantizations 🚀
![Featherless AI Quants](./featherless-quants.png)
*Optimized GGUF quantization files for enhanced model performance*
> Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
---
## Available Quantizations 📊
| Quantization Type | File | Size |
|-------------------|------|------|
| IQ4_XS | [R1pathak-TinyLlama_v1.1_float16_0.0-IQ4_XS.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-IQ4_XS.gguf) | 581.56 MB |
| Q2_K | [R1pathak-TinyLlama_v1.1_float16_0.0-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q2_K.gguf) | 412.11 MB |
| Q3_K_L | [R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_L.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_L.gguf) | 564.12 MB |
| Q3_K_M | [R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_M.gguf) | 523.00 MB |
| Q3_K_S | [R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q3_K_S.gguf) | 476.21 MB |
| Q4_K_M | [R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_M.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_M.gguf) | 636.88 MB |
| Q4_K_S | [R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_S.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q4_K_S.gguf) | 610.23 MB |
| Q5_K_M | [R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_M.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_M.gguf) | 745.82 MB |
| Q5_K_S | [R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_S.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q5_K_S.gguf) | 730.54 MB |
| Q6_K | [R1pathak-TinyLlama_v1.1_float16_0.0-Q6_K.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q6_K.gguf) | 861.56 MB |
| Q8_0 | [R1pathak-TinyLlama_v1.1_float16_0.0-Q8_0.gguf](https://huggingface.co/featherless-ai-quants/R1pathak-TinyLlama_v1.1_float16_0.0-GGUF/blob/main/R1pathak-TinyLlama_v1.1_float16_0.0-Q8_0.gguf) | 1115.62 MB |
---
## ⚡ Powered by [Featherless AI](https://featherless.ai)
### Key Features
- 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
- 🛠️ **Zero Infrastructure** - No server setup or maintenance required
- 📚 **Vast Compatibility** - Support for 2400+ models and counting
- 💎 **Affordable Pricing** - Starting at just $10/month
---
**Links:**
[Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)

3
featherless-quants.png Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
size 1614532