初始化项目,由ModelHub XC社区提供模型
Model: afrideva/smol-3b-GGUF Source: Original Platform
This commit is contained in:
42
.gitattributes
vendored
Normal file
42
.gitattributes
vendored
Normal file
@@ -0,0 +1,42 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
smol-3b.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
48
README.md
Normal file
48
README.md
Normal file
@@ -0,0 +1,48 @@
|
|||||||
|
---
|
||||||
|
base_model: rishiraj/smol-3b
|
||||||
|
inference: false
|
||||||
|
library_name: peft
|
||||||
|
license: apache-2.0
|
||||||
|
model-index:
|
||||||
|
- name: smol-3b
|
||||||
|
results: []
|
||||||
|
model_creator: rishiraj
|
||||||
|
model_name: smol-3b
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
quantized_by: afrideva
|
||||||
|
tags:
|
||||||
|
- generated_from_trainer
|
||||||
|
- gguf
|
||||||
|
- ggml
|
||||||
|
- quantized
|
||||||
|
- q2_k
|
||||||
|
- q3_k_m
|
||||||
|
- q4_k_m
|
||||||
|
- q5_k_m
|
||||||
|
- q6_k
|
||||||
|
- q8_0
|
||||||
|
---
|
||||||
|
# rishiraj/smol-3b-GGUF
|
||||||
|
|
||||||
|
Quantized GGUF model files for [smol-3b](https://huggingface.co/rishiraj/smol-3b) from [rishiraj](https://huggingface.co/rishiraj)
|
||||||
|
|
||||||
|
|
||||||
|
| Name | Quant method | Size |
|
||||||
|
| ---- | ---- | ---- |
|
||||||
|
| [smol-3b.fp16.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.fp16.gguf) | fp16 | 6.04 GB |
|
||||||
|
| [smol-3b.q2_k.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q2_k.gguf) | q2_k | 1.30 GB |
|
||||||
|
| [smol-3b.q3_k_m.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q3_k_m.gguf) | q3_k_m | 1.51 GB |
|
||||||
|
| [smol-3b.q4_k_m.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q4_k_m.gguf) | q4_k_m | 1.85 GB |
|
||||||
|
| [smol-3b.q5_k_m.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q5_k_m.gguf) | q5_k_m | 2.15 GB |
|
||||||
|
| [smol-3b.q6_k.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q6_k.gguf) | q6_k | 2.48 GB |
|
||||||
|
| [smol-3b.q8_0.gguf](https://huggingface.co/afrideva/smol-3b-GGUF/resolve/main/smol-3b.q8_0.gguf) | q8_0 | 3.21 GB |
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
## Original Model Card:
|
||||||
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
||||||
|
should probably proofread and complete it, then remove this comment. -->
|
||||||
|
|
||||||
|
# smol-3b
|
||||||
|
|
||||||
|
See how open weights instead of open source feel like!
|
||||||
3
smol-3b.fp16.gguf
Normal file
3
smol-3b.fp16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f8511c53e754c31485866160d428630f4590b1ae8784636122e33745b42b3987
|
||||||
|
size 6043442368
|
||||||
3
smol-3b.q2_k.gguf
Normal file
3
smol-3b.q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:59c142e2d7f94203daeb04ce4675a0830d03ea280119c4ffd2dba07f317e70f3
|
||||||
|
size 1298337536
|
||||||
3
smol-3b.q3_k_m.gguf
Normal file
3
smol-3b.q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c2a61e6acf47a3c09ee67c28f311e6ba197de2f7180f8dcf685f7302116b4085
|
||||||
|
size 1508728064
|
||||||
3
smol-3b.q4_k_m.gguf
Normal file
3
smol-3b.q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ddb19ce4317e3ebd514f3edf7dc6ee2e3e2926390ad680bb8a81981d25f1aa13
|
||||||
|
size 1847804672
|
||||||
3
smol-3b.q5_k_m.gguf
Normal file
3
smol-3b.q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e2bad4e711542276b1650931f8ad35aa63a1303c134cada92a7d39645571074d
|
||||||
|
size 2154537728
|
||||||
3
smol-3b.q6_k.gguf
Normal file
3
smol-3b.q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8fde7183831d144ee17d57380511ddc0a47afd7073c0da3478f774c5d675e19b
|
||||||
|
size 2480441600
|
||||||
3
smol-3b.q8_0.gguf
Normal file
3
smol-3b.q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:316985f14d8cba9d75431d8035ef5d011e9a5c3e6ead7aa256dade6dc495e9d2
|
||||||
|
size 3211918592
|
||||||
Reference in New Issue
Block a user