mradermacher/Step3-VL-10B-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Step3-VL-10B-Base-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-04 20:35:55 +08:00
commit 53ab349450
27 changed files with 222 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Step3-VL-10B-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: stepfun-ai/Step3-VL-10B-Base
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/stepfun-ai/Step3-VL-10B-Base
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Step3-VL-10B-Base-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Step3-VL-10B-Base-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Step3-VL-10B-Base-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Step3-VL-10B-Base.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d96be2ac0d59039648526fe7d26e883b6d6aefc039dd0094ee6fd5a372207116
size 2256144032

3
Step3-VL-10B-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c7d255cfb3f304e5625e4ba986422af57471486937784e76df7e8b8abde8770
size 2115765920

3
Step3-VL-10B-Base.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f4115a2b0b5c4b609475f280b5a403fdf5b28a5100785057c873ad05a53a8de
size 3051910816

3
Step3-VL-10B-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8dc3b77b1fe1e98c2bf698a61431e05815aa9d03bb800a9cc309a39eb053e3d
size 2864740000

3
Step3-VL-10B-Base.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a85e686d79dc5b60c2dc203cc3622bb22911c50df5077bc5b8c57739a87d37b
size 2696152736

3
Step3-VL-10B-Base.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1748ae97457293071311a71e672d494ff695a5e295d64600a359946a4ddc25ef
size 2490107552

3
Step3-VL-10B-Base.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e973d255765bd8853772596a2a0f1f72534745b97f28673df803a3fa2859d64b
size 3896616608

3
Step3-VL-10B-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64828188ef34372e0061632d487daf0c206ed141639ee36c88ecf57f947240ac
size 3789661856

3
Step3-VL-10B-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7128bc0b9c9f717b1c3c1ae8f632b4ca64992f2dc17064e03a931573ceae0c0
size 3626870432

3
Step3-VL-10B-Base.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc689f0df734d15d4cd99f30a1f18c00703237392c391ffa463cd3ddd3286583
size 3369629344

3
Step3-VL-10B-Base.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73dd3298a7c3dbd439812daffdb5d3bad0ca33c78c9bf7d6a854535a207f9660
size 4793620128

3
Step3-VL-10B-Base.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6cd8c39a51a39dc427ca31a4da3f1d33642b3cfb5adb355b1a2713f598e1d8c
size 4561835680

3
Step3-VL-10B-Base.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c9614c801ff046b5106cc85d1d5819f724953fb2c59c4d07fefc2316c91fa3d
size 3281729184

3
Step3-VL-10B-Base.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e92c308fa11447ec839abc2e09c45954bbd0e5388040c239877038459feacf32
size 3083548320

3
Step3-VL-10B-Base.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2176227acd680a1e01eab6c632ea091ef4744afd68fd3661ad9012416395ab30
size 4431390368

3
Step3-VL-10B-Base.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5defeb291faf9e4cdf7e3c9983191bbbd063379aba1a2cf80506706412ff10b0
size 4124157600

3
Step3-VL-10B-Base.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4096d6c59787ae4b31da5d9332d8158f998bfc2598ebeb42f7455fd0c47066e
size 3769607840

3
Step3-VL-10B-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9d1f55043370222c7d4de47557077d6b5d0ae8fc21a179d7cf3bbd0dd566f7d
size 4787328672

3
Step3-VL-10B-Base.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:579a1ec898d7b167db40becc7843f75bcb8cc6c817b82f332a0d25c7af57b7bf
size 5247751840

3
Step3-VL-10B-Base.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ccdfa62e07e6404aba249043cd0555683f8ebaf20fd117fe896517587096003
size 5027780256

3
Step3-VL-10B-Base.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43875f50fc503503fd4d6afe1b3f0cfceb4292ac5ef04f63c95e5658d4a93ad2
size 4802008736

3
Step3-VL-10B-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a2d8085bfe32dfc18f983c18ce67ca4490f43363caa6aa2619b43aa3739ce53
size 5851109024

3
Step3-VL-10B-Base.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9215adc5945bae9ce30940b3fe8068b8846ee75f79708e9be763cc58f816595
size 5720757920

3
Step3-VL-10B-Base.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cca9be5be83ff0a22d60f1691b6f3fb9f6c9652a6a52b34ffb162939a005691
size 6725895840

3
Step3-VL-10B-Base.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7069f444b20087165e7c979f53a97ade2dc07356186b1538c2214c5519f36558
size 5347200