commit 53ab349450970409454d71e26d26a412c4f86516 Author: ModelHub XC Date: Mon May 4 20:35:55 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Step3-VL-10B-Base-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..df6a4f7 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Step3-VL-10B-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..6b7307f --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +base_model: stepfun-ai/Step3-VL-10B-Base +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/stepfun-ai/Step3-VL-10B-Base + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Step3-VL-10B-Base-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Step3-VL-10B-Base-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Step3-VL-10B-Base-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | | +| [GGUF](https://huggingface.co/mradermacher/Step3-VL-10B-Base-i1-GGUF/resolve/main/Step3-VL-10B-Base.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/Step3-VL-10B-Base.i1-IQ1_M.gguf b/Step3-VL-10B-Base.i1-IQ1_M.gguf new file mode 100644 index 0000000..a1fd837 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d96be2ac0d59039648526fe7d26e883b6d6aefc039dd0094ee6fd5a372207116 +size 2256144032 diff --git a/Step3-VL-10B-Base.i1-IQ1_S.gguf b/Step3-VL-10B-Base.i1-IQ1_S.gguf new file mode 100644 index 0000000..9e1263c --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0c7d255cfb3f304e5625e4ba986422af57471486937784e76df7e8b8abde8770 +size 2115765920 diff --git a/Step3-VL-10B-Base.i1-IQ2_M.gguf b/Step3-VL-10B-Base.i1-IQ2_M.gguf new file mode 100644 index 0000000..d7f5c02 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f4115a2b0b5c4b609475f280b5a403fdf5b28a5100785057c873ad05a53a8de +size 3051910816 diff --git a/Step3-VL-10B-Base.i1-IQ2_S.gguf b/Step3-VL-10B-Base.i1-IQ2_S.gguf new file mode 100644 index 0000000..215c41d --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8dc3b77b1fe1e98c2bf698a61431e05815aa9d03bb800a9cc309a39eb053e3d +size 2864740000 diff --git a/Step3-VL-10B-Base.i1-IQ2_XS.gguf b/Step3-VL-10B-Base.i1-IQ2_XS.gguf new file mode 100644 index 0000000..fbb9525 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a85e686d79dc5b60c2dc203cc3622bb22911c50df5077bc5b8c57739a87d37b +size 2696152736 diff --git a/Step3-VL-10B-Base.i1-IQ2_XXS.gguf b/Step3-VL-10B-Base.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..01caf5e --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1748ae97457293071311a71e672d494ff695a5e295d64600a359946a4ddc25ef +size 2490107552 diff --git a/Step3-VL-10B-Base.i1-IQ3_M.gguf b/Step3-VL-10B-Base.i1-IQ3_M.gguf new file mode 100644 index 0000000..655b72f --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e973d255765bd8853772596a2a0f1f72534745b97f28673df803a3fa2859d64b +size 3896616608 diff --git a/Step3-VL-10B-Base.i1-IQ3_S.gguf b/Step3-VL-10B-Base.i1-IQ3_S.gguf new file mode 100644 index 0000000..1df5bd8 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:64828188ef34372e0061632d487daf0c206ed141639ee36c88ecf57f947240ac +size 3789661856 diff --git a/Step3-VL-10B-Base.i1-IQ3_XS.gguf b/Step3-VL-10B-Base.i1-IQ3_XS.gguf new file mode 100644 index 0000000..7280cd6 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7128bc0b9c9f717b1c3c1ae8f632b4ca64992f2dc17064e03a931573ceae0c0 +size 3626870432 diff --git a/Step3-VL-10B-Base.i1-IQ3_XXS.gguf b/Step3-VL-10B-Base.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..ad3a9e7 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc689f0df734d15d4cd99f30a1f18c00703237392c391ffa463cd3ddd3286583 +size 3369629344 diff --git a/Step3-VL-10B-Base.i1-IQ4_NL.gguf b/Step3-VL-10B-Base.i1-IQ4_NL.gguf new file mode 100644 index 0000000..040d9c6 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:73dd3298a7c3dbd439812daffdb5d3bad0ca33c78c9bf7d6a854535a207f9660 +size 4793620128 diff --git a/Step3-VL-10B-Base.i1-IQ4_XS.gguf b/Step3-VL-10B-Base.i1-IQ4_XS.gguf new file mode 100644 index 0000000..2adbd63 --- /dev/null +++ b/Step3-VL-10B-Base.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a6cd8c39a51a39dc427ca31a4da3f1d33642b3cfb5adb355b1a2713f598e1d8c +size 4561835680 diff --git a/Step3-VL-10B-Base.i1-Q2_K.gguf b/Step3-VL-10B-Base.i1-Q2_K.gguf new file mode 100644 index 0000000..47b0e65 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c9614c801ff046b5106cc85d1d5819f724953fb2c59c4d07fefc2316c91fa3d +size 3281729184 diff --git a/Step3-VL-10B-Base.i1-Q2_K_S.gguf b/Step3-VL-10B-Base.i1-Q2_K_S.gguf new file mode 100644 index 0000000..dadd3bb --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e92c308fa11447ec839abc2e09c45954bbd0e5388040c239877038459feacf32 +size 3083548320 diff --git a/Step3-VL-10B-Base.i1-Q3_K_L.gguf b/Step3-VL-10B-Base.i1-Q3_K_L.gguf new file mode 100644 index 0000000..02a0240 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2176227acd680a1e01eab6c632ea091ef4744afd68fd3661ad9012416395ab30 +size 4431390368 diff --git a/Step3-VL-10B-Base.i1-Q3_K_M.gguf b/Step3-VL-10B-Base.i1-Q3_K_M.gguf new file mode 100644 index 0000000..851b408 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5defeb291faf9e4cdf7e3c9983191bbbd063379aba1a2cf80506706412ff10b0 +size 4124157600 diff --git a/Step3-VL-10B-Base.i1-Q3_K_S.gguf b/Step3-VL-10B-Base.i1-Q3_K_S.gguf new file mode 100644 index 0000000..62a7686 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4096d6c59787ae4b31da5d9332d8158f998bfc2598ebeb42f7455fd0c47066e +size 3769607840 diff --git a/Step3-VL-10B-Base.i1-Q4_0.gguf b/Step3-VL-10B-Base.i1-Q4_0.gguf new file mode 100644 index 0000000..3a88f1b --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9d1f55043370222c7d4de47557077d6b5d0ae8fc21a179d7cf3bbd0dd566f7d +size 4787328672 diff --git a/Step3-VL-10B-Base.i1-Q4_1.gguf b/Step3-VL-10B-Base.i1-Q4_1.gguf new file mode 100644 index 0000000..fb4d3d0 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:579a1ec898d7b167db40becc7843f75bcb8cc6c817b82f332a0d25c7af57b7bf +size 5247751840 diff --git a/Step3-VL-10B-Base.i1-Q4_K_M.gguf b/Step3-VL-10B-Base.i1-Q4_K_M.gguf new file mode 100644 index 0000000..a336380 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5ccdfa62e07e6404aba249043cd0555683f8ebaf20fd117fe896517587096003 +size 5027780256 diff --git a/Step3-VL-10B-Base.i1-Q4_K_S.gguf b/Step3-VL-10B-Base.i1-Q4_K_S.gguf new file mode 100644 index 0000000..f0d9b14 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43875f50fc503503fd4d6afe1b3f0cfceb4292ac5ef04f63c95e5658d4a93ad2 +size 4802008736 diff --git a/Step3-VL-10B-Base.i1-Q5_K_M.gguf b/Step3-VL-10B-Base.i1-Q5_K_M.gguf new file mode 100644 index 0000000..82b4872 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6a2d8085bfe32dfc18f983c18ce67ca4490f43363caa6aa2619b43aa3739ce53 +size 5851109024 diff --git a/Step3-VL-10B-Base.i1-Q5_K_S.gguf b/Step3-VL-10B-Base.i1-Q5_K_S.gguf new file mode 100644 index 0000000..114cf47 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c9215adc5945bae9ce30940b3fe8068b8846ee75f79708e9be763cc58f816595 +size 5720757920 diff --git a/Step3-VL-10B-Base.i1-Q6_K.gguf b/Step3-VL-10B-Base.i1-Q6_K.gguf new file mode 100644 index 0000000..0c41e64 --- /dev/null +++ b/Step3-VL-10B-Base.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5cca9be5be83ff0a22d60f1691b6f3fb9f6c9652a6a52b34ffb162939a005691 +size 6725895840 diff --git a/Step3-VL-10B-Base.imatrix.gguf b/Step3-VL-10B-Base.imatrix.gguf new file mode 100644 index 0000000..ac3b370 --- /dev/null +++ b/Step3-VL-10B-Base.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7069f444b20087165e7c979f53a97ade2dc07356186b1538c2214c5519f36558 +size 5347200