mradermacher/SmolVLM-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/SmolVLM-Base-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-21 21:21:53 +08:00
commit 466a81999f
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolVLM-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: HuggingFaceTB/SmolVLM-Base
datasets:
- HuggingFaceM4/the_cauldron
- HuggingFaceM4/Docmatix
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/HuggingFaceTB/SmolVLM-Base
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#SmolVLM-Base-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/SmolVLM-Base-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/SmolVLM-Base-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/SmolVLM-Base-i1-GGUF/resolve/main/SmolVLM-Base.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
SmolVLM-Base.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8df45212b78b76c6d349d274e051cd3c09b2636cedb62ac8c2575b2c6a973399
size 477196832

3
SmolVLM-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:018022b7bfa9752513eb3ab4a3f9ab5509231c3c81c945f59f047f42f4748986
size 445346336

3
SmolVLM-Base.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45dba136c0b54705b8187f2d13eba534651b076146a1f6a1ca326242f6b6e91b
size 658076832

3
SmolVLM-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88994979d77ff2bbc3c2ea6f32a168ed33716b4567413a0120334c0297e595ab
size 615609504

3
SmolVLM-Base.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:806423b3d7882f62f91eeaba9b5e5258c69b17a4b42b1b99feefa6fa59eca5b7
size 575894048

3
SmolVLM-Base.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac49ca574b6dbd2c12cc22b1bf8f23afb774e2a72c97bff3d434dd9d51ea9fac
size 530280992

3
SmolVLM-Base.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe3586e08ee60a8ae2f68a15ecbbe41c4f38188270644305330f12771f121aa5
size 853506016

3
SmolVLM-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49faf6398a018bbd32e2242966dd6b9e3b96296985ea979a35b7189a4c2cff16
size 820082656

3
SmolVLM-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b89159f48cfa60a2ed59b481c937cf75167a839e76d61646f858b85d3cb3ca05
size 782333920

3
SmolVLM-Base.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57cbd8b28e15fb4ee80d96e487b2a402204eeb8ab70fbc6c388bc2a8da1be0ae
size 723350688

3
SmolVLM-Base.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:deb40c23778f198e26e479a9c825dad2af369ea62ac8256bf5617a541a9c0984
size 1047362304

3
SmolVLM-Base.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3335681cbf94e101a8b6c2fb1de49017bc70f867e65ca3b56bb45754cdd6e0cf
size 993884736

3
SmolVLM-Base.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c56c483628a2e7e7c85d5253219a6268d1b9d8915fc07b52a072922e6862da7
size 707622240

3
SmolVLM-Base.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75db59d79457ec3947588c54a514a026418b8f4f300f2784082f66c412402af5
size 658077024

3
SmolVLM-Base.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f32b5419f451f61a7e92f6a40948c4acb8b36eb69d85936a468be5ee6ec0c80e
size 975796192

3
SmolVLM-Base.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a526c8b26506d6490ed64925aa0f5460b5e250fbdd9fc3173c53cade779462dc
size 903444448

3
SmolVLM-Base.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de3fd5916bb567a83c7e7903a3406a5a0a4bf5978f255c9b2b7f92d26a8795db
size 820082656

3
SmolVLM-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ba70044e9c09d6145b5602254fdd7d38bd9b5ae7b0f3367b37106a3fc570ba4
size 1050508032

3
SmolVLM-Base.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:678a7ee644e55510aba094dde662592f1c939b3f1eb47a7a66a63399187b39ff
size 1154317440

3
SmolVLM-Base.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e572a25c22a39ca18d565d1b5a32bb3425c223a296b96672635da5862228971
size 1112242944

3
SmolVLM-Base.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69916e3909e50eed021b46fe66642ce0ac68b5c1791bd1e5e28fe65c2e6f998a
size 1055750912

3
SmolVLM-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e54dd0585f65143241a29f795563d05e12596d96b39f1717540b4e1f51d0e63
size 1294695936

3
SmolVLM-Base.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e94c0e83521533b80de52bf6f2642cbd16adced031e5cdf1185251bef60e9f79
size 1261272576

3
SmolVLM-Base.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cb47372b852d4d0f649846ad83b09704c2b046a9c79ee352eca690d106b7f57
size 1488552256

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4af900a488a4a213fda7ff84318e5537c736ec704c839c75ecc53e4d32244c93
size 1971637