commit 22fc66b10f8dfb458e962fdef2ffaf9283e76d7c Author: ModelHub XC Date: Sun May 31 02:31:19 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Pelican1.0-VL-3B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b2cae88 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Pelican1.0-VL-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Pelican1.0-VL-3B.i1-IQ1_M.gguf b/Pelican1.0-VL-3B.i1-IQ1_M.gguf new file mode 100644 index 0000000..b410c7a --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:945c790631379d427e400d853cae5416935e7f46d8d05def105d88a36dbf7337 +size 850026240 diff --git a/Pelican1.0-VL-3B.i1-IQ1_S.gguf b/Pelican1.0-VL-3B.i1-IQ1_S.gguf new file mode 100644 index 0000000..9af88bd --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:544fcda43f498420d656f99c39a99f80797416dbbccd242c0f1bb57dce26dee6 +size 791092992 diff --git a/Pelican1.0-VL-3B.i1-IQ2_M.gguf b/Pelican1.0-VL-3B.i1-IQ2_M.gguf new file mode 100644 index 0000000..37aa41c --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e68bd0062fdf7ce2b93c947aa7058e84aac8a773e538a20e8cf6fd99a837f933 +size 1140514560 diff --git a/Pelican1.0-VL-3B.i1-IQ2_S.gguf b/Pelican1.0-VL-3B.i1-IQ2_S.gguf new file mode 100644 index 0000000..556dbd7 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e625bcd53e5568b397d2d134b5da148e1852811960db378cf4155f357c42ffdf +size 1061936896 diff --git a/Pelican1.0-VL-3B.i1-IQ2_XS.gguf b/Pelican1.0-VL-3B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..5c320a0 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40853688f71e3a8c573b077680fcbd0d2feb25e5e4282fd531a3439a81d64d1f +size 1031544576 diff --git a/Pelican1.0-VL-3B.i1-IQ2_XXS.gguf b/Pelican1.0-VL-3B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..78f8741 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c9e7d3a7a1276922dd3d98deb8aaf4338b6540042bdfb96dc4f4c4fb4b0f9166 +size 948248320 diff --git a/Pelican1.0-VL-3B.i1-IQ3_M.gguf b/Pelican1.0-VL-3B.i1-IQ3_M.gguf new file mode 100644 index 0000000..bfb40ef --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:738440e58ea3732cfb59f5f6a8cb7a011d45c353b51ea398ef679f9f4265a408 +size 1488893696 diff --git a/Pelican1.0-VL-3B.i1-IQ3_S.gguf b/Pelican1.0-VL-3B.i1-IQ3_S.gguf new file mode 100644 index 0000000..0ce1092 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b141181ca8087f29b41d0ed80150e2fe0b32342efd766891f67ad7375dd5267a +size 1456862976 diff --git a/Pelican1.0-VL-3B.i1-IQ3_XS.gguf b/Pelican1.0-VL-3B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..5e2a13d --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf4f3845950ab5c54bbebce986466ba84f193258809c5ff2b75344b48f08bfda +size 1391834880 diff --git a/Pelican1.0-VL-3B.i1-IQ3_XXS.gguf b/Pelican1.0-VL-3B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..a6e8af1 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d8ff1d91f50424c75be6af618e3d3a333ef02a5706be1d2832489f45147b00f +size 1282825984 diff --git a/Pelican1.0-VL-3B.i1-IQ4_NL.gguf b/Pelican1.0-VL-3B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..13fcd35 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:495517d61135bde8201c23a80331ea059d2ed1431fb384bfaf6b048177e9eeea +size 1825208064 diff --git a/Pelican1.0-VL-3B.i1-IQ4_XS.gguf b/Pelican1.0-VL-3B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..15d3518 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09ee80843fb4ee922fe5da9d23b472bd6af9223fb2edbb403eb759593d433d30 +size 1739093760 diff --git a/Pelican1.0-VL-3B.i1-Q2_K.gguf b/Pelican1.0-VL-3B.i1-Q2_K.gguf new file mode 100644 index 0000000..520869d --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:746300af13dc109c6bbbcc71715a6b9fb0a3894723a82727123e3955a39c8b6c +size 1274754816 diff --git a/Pelican1.0-VL-3B.i1-Q2_K_S.gguf b/Pelican1.0-VL-3B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..7ea7de8 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:681e8369db9de5b20c1e9b6506a05ee97ba59e3422a01460d5cd54333b89aad6 +size 1198126848 diff --git a/Pelican1.0-VL-3B.i1-Q3_K_L.gguf b/Pelican1.0-VL-3B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..742ad99 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8d89a5acef6d9e2fdfce57620ce8871344ca667cabae5f530b6bf7237b6cfa3d +size 1707390720 diff --git a/Pelican1.0-VL-3B.i1-Q3_K_M.gguf b/Pelican1.0-VL-3B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a60dbc8 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6613c25343e212bd289e7070fb14ed89a9412338ffbd2337ccecb175234e461c +size 1590474496 diff --git a/Pelican1.0-VL-3B.i1-Q3_K_S.gguf b/Pelican1.0-VL-3B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..af9724e --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:32420e843fdd256e4ff98ff7d6ba56c333577b379a4f1a981c4d9c0569fdafbc +size 1454356224 diff --git a/Pelican1.0-VL-3B.i1-Q4_0.gguf b/Pelican1.0-VL-3B.i1-Q4_0.gguf new file mode 100644 index 0000000..aade1ca --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f45904fcad990603b468912eb70bfd6e135f4730445b2a304b3dc1fd1282274 +size 1828484864 diff --git a/Pelican1.0-VL-3B.i1-Q4_1.gguf b/Pelican1.0-VL-3B.i1-Q4_1.gguf new file mode 100644 index 0000000..a41e2b2 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d478a39d8803346e728ee0e04ec831b922d3e0ab837471c568efd19e4f39f4ff +size 1996257024 diff --git a/Pelican1.0-VL-3B.i1-Q4_K_M.gguf b/Pelican1.0-VL-3B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..549a5be --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4c4e23f0065466bf7609a06fda206186d48f8b32df8a9d28971a003f7d0af17 +size 1929901824 diff --git a/Pelican1.0-VL-3B.i1-Q4_K_S.gguf b/Pelican1.0-VL-3B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..e9991b6 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:41ead28f3074625c2c993c21349eee68a9361668d238d9145321342b54e73694 +size 1834383104 diff --git a/Pelican1.0-VL-3B.i1-Q5_K_M.gguf b/Pelican1.0-VL-3B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..5941935 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:25ef405c847a1c2363c62ca1e0fa8ed3ece3276ba10ab783b8795acd9ef8ec12 +size 2224813824 diff --git a/Pelican1.0-VL-3B.i1-Q5_K_S.gguf b/Pelican1.0-VL-3B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..c894e90 --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f2ca6c0c56e73283c607b0918b44a35f85be321cb759e70940f7aae0f66d2da +size 2169665280 diff --git a/Pelican1.0-VL-3B.i1-Q6_K.gguf b/Pelican1.0-VL-3B.i1-Q6_K.gguf new file mode 100644 index 0000000..f6e99cb --- /dev/null +++ b/Pelican1.0-VL-3B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f951c6bf898a978ec219cd3216bda4d19ca52c61adb68987ae9662c2e25f8977 +size 2538157824 diff --git a/Pelican1.0-VL-3B.imatrix.gguf b/Pelican1.0-VL-3B.imatrix.gguf new file mode 100644 index 0000000..fa8dbb6 --- /dev/null +++ b/Pelican1.0-VL-3B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:233a5b703b627cb0229a308271d8db1f5464318cd11ee238613c6ea887f83bf7 +size 3393408 diff --git a/README.md b/README.md new file mode 100644 index 0000000..ed1b4a3 --- /dev/null +++ b/README.md @@ -0,0 +1,91 @@ +--- +base_model: X-Humanoid/Pelican1.0-VL-3B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- multimodal-learning +- embodied-ai +- robotics +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/X-Humanoid/Pelican1.0-VL-3B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Pelican1.0-VL-3B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Pelican1.0-VL-3B-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Pelican1.0-VL-3B-i1-GGUF/resolve/main/Pelican1.0-VL-3B.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +