afrideva/smol-3b-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: afrideva/smol-3b-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-05 09:52:39 +08:00
commit 6e9a664bf4
9 changed files with 111 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

42
.gitattributes vendored Normal file
View File

@@ -0,0 +1,42 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
smol-3b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
smol-3b.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
smol-3b.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
smol-3b.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
smol-3b.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
smol-3b.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
smol-3b.q8_0.gguf filter=lfs diff=lfs merge=lfs -text

48
README.md Normal file
View File

@@ -0,0 +1,48 @@
---
base_model: rishiraj/smol-3b
inference: false
library_name: peft
license: apache-2.0
model-index:
- name: smol-3b
results: []
model_creator: rishiraj
model_name: smol-3b
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- generated_from_trainer
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
---
# rishiraj/smol-3b-GGUF
Quantized GGUF model files for [smol-3b](https://huggingface.co/rishiraj/smol-3b) from [rishiraj](https://huggingface.co/rishiraj)
| Name | Quant method | Size |
| ---- | ---- | ---- |
| [smol-3b.fp16.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.fp16.gguf) | fp16 | 6.04 GB |
| [smol-3b.q2_k.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q2_k.gguf) | q2_k | 1.30 GB |
| [smol-3b.q3_k_m.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q3_k_m.gguf) | q3_k_m | 1.51 GB |
| [smol-3b.q4_k_m.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q4_k_m.gguf) | q4_k_m | 1.85 GB |
| [smol-3b.q5_k_m.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q5_k_m.gguf) | q5_k_m | 2.15 GB |
| [smol-3b.q6_k.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q6_k.gguf) | q6_k | 2.48 GB |
| [smol-3b.q8_0.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q8_0.gguf) | q8_0 | 3.21 GB |
## Original Model Card:
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# smol-3b
See how open weights instead of open source feel like!

3
smol-3b.fp16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8511c53e754c31485866160d428630f4590b1ae8784636122e33745b42b3987
size 6043442368

3
smol-3b.q2_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59c142e2d7f94203daeb04ce4675a0830d03ea280119c4ffd2dba07f317e70f3
size 1298337536

3
smol-3b.q3_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2a61e6acf47a3c09ee67c28f311e6ba197de2f7180f8dcf685f7302116b4085
size 1508728064

3
smol-3b.q4_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddb19ce4317e3ebd514f3edf7dc6ee2e3e2926390ad680bb8a81981d25f1aa13
size 1847804672

3
smol-3b.q5_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2bad4e711542276b1650931f8ad35aa63a1303c134cada92a7d39645571074d
size 2154537728

3
smol-3b.q6_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8fde7183831d144ee17d57380511ddc0a47afd7073c0da3478f774c5d675e19b
size 2480441600

3
smol-3b.q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:316985f14d8cba9d75431d8035ef5d011e9a5c3e6ead7aa256dade6dc495e9d2
size 3211918592