mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-07 06:32:17 +08:00
commit 1a52e1b90f
27 changed files with 233 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM2-2.2B-Instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

98
README.md Normal file
View File

@@ -0,0 +1,98 @@
---
base_model: HuggingFaceTB/SmolVLM2-2.2B-Instruct
datasets:
- HuggingFaceM4/the_cauldron
- HuggingFaceM4/Docmatix
- lmms-lab/LLaVA-OneVision-Data
- lmms-lab/M4-Instruct-Data
- HuggingFaceFV/finevideo
- MAmmoTH-VL/MAmmoTH-VL-Instruct-12M
- lmms-lab/LLaVA-Video-178K
- orrzohar/Video-STaR
- Mutonix/Vript
- TIGER-Lab/VISTA-400K
- Enxin/MovieChat-1K_train
- ShareGPT4Video/ShareGPT4Video
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- video-text-to-text
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/HuggingFaceTB/SmolVLM2-2.2B-Instruct
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#SmolVLM2-2.2B-Instruct-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM2-2.2B-Instruct-i1-GGUF/resolve/main/SmolVLM2-2.2B-Instruct.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
SmolVLM2-2.2B-Instruct.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:009d602d8abbd378a7f459057cbcf51c506957230e4ffddb071837eb02effc83
size 477463264

3
SmolVLM2-2.2B-Instruct.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04ef5aee2166ca99e1af804a54195e0d3aa0900fee61808b1eb516fd83fc6d4f
size 445612768

3
SmolVLM2-2.2B-Instruct.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3371d00775ece7c3e06cca47cc57266151cf1c8acebfedcf3fb4ab4f7e747d1a
size 658369248

3
SmolVLM2-2.2B-Instruct.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32e3064bf2ccebd41866eb86d1bbac513ecb6277cd8ad71048ac0a68313d2c31
size 615901920

3
SmolVLM2-2.2B-Instruct.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c848291b5d49cb7ab068d0761843e8650185e6e466d9fe5e2b7ead3fa45eaf65
size 576160480

3
SmolVLM2-2.2B-Instruct.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5767c6b9dac054363ffca1ee71f1e11bcd5fc8b499f0e8cc80c916693434e1d
size 530547424

3
SmolVLM2-2.2B-Instruct.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:719c767467f9e4d4e28ddee9f0599ec23f4df4c085ef5d68721fd28702a292ea
size 853832416

3
SmolVLM2-2.2B-Instruct.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3565eac5fd5c8b7d3b57da9b053a73ca43f291a159dd0fa394e843e3bff22e89
size 820409056

3
SmolVLM2-2.2B-Instruct.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5767fdb564bf58814244c7d7e10003e76b5071dfd29df74bf08152bf71eaac9
size 782660320

3
SmolVLM2-2.2B-Instruct.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:307e536368993e7d3019fc361c309e4890c830ab5286198781975e7512ae64e3
size 723643104

3
SmolVLM2-2.2B-Instruct.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7a3920e5daf54bef87bcf2249ff42dee550410de042c93fdbb464d60f185673
size 1047722720

3
SmolVLM2-2.2B-Instruct.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b9f08362cea18cb2cf0b999c5630739cf8a0a892a854f0f5b08748f8f74b29f
size 994237152

3
SmolVLM2-2.2B-Instruct.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef9d382a93d3cb1f9995b2a0a45ba93c6b7127bd013c0680e28dc3b22e2dd895
size 707922656

3
SmolVLM2-2.2B-Instruct.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e37cf8be59d497a19f3ea4449ad8e131bee0c2bbcca198d442c170232dc478f
size 658377440

3
SmolVLM2-2.2B-Instruct.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:537a4ad6dab76de600fdb1e1b00e0083976799fb71a668aa7afddfa82a0d4edd
size 976122592

3
SmolVLM2-2.2B-Instruct.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38c1ec57e1cc582d37550072efbcc36a082ff66671a2a4155ba9289d11732fdc
size 903770848

3
SmolVLM2-2.2B-Instruct.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c49e5177c77deb1e5546fb81279eb40ced0eb4983eb8ce6f32d49d7f448305e0
size 820409056

3
SmolVLM2-2.2B-Instruct.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0794f9d23b3df8c4afa89ff37ef7fefd61928746712bfea0c98cf13903078b2a
size 1050868448

3
SmolVLM2-2.2B-Instruct.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:268ebab5d75e468c98d6273ce1bf2b03028c3f3996d71c1492f90c1f7b562dc1
size 1154693856

3
SmolVLM2-2.2B-Instruct.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee7686d62803324070326dd65e7432490f22983eb6689f0d86efdf93c78d1f62
size 1112603360

3
SmolVLM2-2.2B-Instruct.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0eb6069407a621194d677ae8d589e76ffff8477acb9be6a1e88089831387b10d
size 1056111328

3
SmolVLM2-2.2B-Instruct.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:565c2b7f25c537a4790d1a97188d94f79c6034a5e04eca30a11ebd81ba246286
size 1295088352

3
SmolVLM2-2.2B-Instruct.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3a26390cb598be0913859ae682f4cb9b1e340394dd36c09e57f4d9e4a75cf03
size 1261664992

3
SmolVLM2-2.2B-Instruct.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:660b1ae2ca777c7b07e0cd4d3a8d2ac7c44d178cb76e9a497420589ba3e87cd8
size 1488978656

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3b951bf91aa39226d9132b6a914b30854469c85d1a04d4b7ffd78b59e37323c
size 1971637