prithivMLmods/SmolLM2-135M-F32-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: prithivMLmods/SmolLM2-135M-F32-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-19 13:59:15 +08:00
commit bb48bbb4b9
17 changed files with 132 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

42
README.md Normal file
View File

@@ -0,0 +1,42 @@
---
license: apache-2.0
language:
- en
base_model:
- HuggingFaceTB/SmolLM2-135M-Instruct
pipeline_tag: text-generation
library_name: transformers
tags:
- text-generation-inference
---
# **SmolLM2-135M-Instruct-GGUF**
> [SmolLM2-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct) : The 135M model was trained on 2 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our own curated datasets. We then applied Direct Preference Optimization (DPO) using UltraFeedback.
## Model Files
| File Name | Size | Format Description |
|-----------|------|-------------------|
| SmolLM2-135M-Instruct.F32.gguf | 540 MB | Full precision (32-bit floating point) |
| SmolLM2-135M-Instruct.BF16.gguf | 271 MB | Brain floating point 16-bit |
| SmolLM2-135M-Instruct.F16.gguf | 271 MB | Half precision (16-bit floating point) |
| SmolLM2-135M-Instruct.Q8_0.gguf | 145 MB | 8-bit quantization |
| SmolLM2-135M-Instruct.Q6_K.gguf | 138 MB | 6-bit quantization (K-quant) |
| SmolLM2-135M-Instruct.Q5_K_M.gguf | 112 MB | 5-bit quantization (K-quant, medium) |
| SmolLM2-135M-Instruct.Q5_K_S.gguf | 110 MB | 5-bit quantization (K-quant, small) |
| SmolLM2-135M-Instruct.Q4_K_M.gguf | 105 MB | 4-bit quantization (K-quant, medium) |
| SmolLM2-135M-Instruct.Q4_K_S.gguf | 102 MB | 4-bit quantization (K-quant, small) |
| SmolLM2-135M-Instruct.Q3_K_L.gguf | 97.5 MB | 3-bit quantization (K-quant, large) |
| SmolLM2-135M-Instruct.Q3_K_M.gguf | 93.5 MB | 3-bit quantization (K-quant, medium) |
| SmolLM2-135M-Instruct.Q3_K_S.gguf | 88.2 MB | 3-bit quantization (K-quant, small) |
| SmolLM2-135M-Instruct.Q2_K.gguf | 88.2 MB | 2-bit quantization (K-quant) |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

3
SmolLM2-135M-Instruct.BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94c6ddc5bf5a2c0ef1130aac48859b0eaf33af33a6aa1527d8fd7354ea0f5206
size 270885792

3
SmolLM2-135M-Instruct.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be0f7c36714bdf456b4f0e60d86b06e199732e0e297730b3af1917c3b7456449
size 270885792

3
SmolLM2-135M-Instruct.F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ce02a34151db35fbc2c6659185ba68978f7a14ad0d488b5ca485e9638e0283d
size 539845536

3
SmolLM2-135M-Instruct.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3496a2b912c11d8d0a272899ce921c2beaf587cf274d461d29fa61a22b0d6db6
size 88201632

3
SmolLM2-135M-Instruct.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ce3fcc7050c5d9fe7666831cd69e256d3f6565f863d79300598a5006d507211
size 97532832

3
SmolLM2-135M-Instruct.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55ae7eb0ec3a0c3905cd38da1f9b8506d57ffa5a5247acea42ffe70c77cbbf0c
size 93510048

3
SmolLM2-135M-Instruct.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ea8fc33a813c6188a7a5da971337bd588b6b43ab02ed3be65a570f9d2d4aa59
size 88201632

3
SmolLM2-135M-Instruct.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a5616477424978d93e67f448e5351a856ea8c234f8ea344ad3755a06ce74662
size 105453984

3
SmolLM2-135M-Instruct.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1213d258498232cd7a92b8adaa81c8a122ea052282b40bd2b8f1fb658c419441
size 102039456

3
SmolLM2-135M-Instruct.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d89a109137450ff5b7836de813868e80708362e0f618876873812c332c6eca4e
size 112103328

3
SmolLM2-135M-Instruct.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4a87e25db0de48c47073e4f8756eb20af7f3da07ff05980f2f3458962e32038
size 109974432

3
SmolLM2-135M-Instruct.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:705b2f61e01afeb72e37f0d08f2ef0523aed1961056156dbfb9d3b8d8af7abb0
size 138382752

3
SmolLM2-135M-Instruct.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbeb64a8bc8a3b70f40774ca8dba4493617cf67c530bde1010920c2da1cd35b4
size 144810912

3
config.json Normal file
View File

@@ -0,0 +1,3 @@
{
"model_type": "llama"
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}