commit 238018dcc6d7cecb14a84066ead1f7113521993c Author: ModelHub XC Date: Sat May 23 10:14:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Proto_Leech-3.2-1B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..7c186fa --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Proto_Leech-3.2-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Proto_Leech-3.2-1B.i1-IQ1_M.gguf b/Proto_Leech-3.2-1B.i1-IQ1_M.gguf new file mode 100644 index 0000000..45535ae --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5eb8c6e4a642af52e07aa7a2b9edf4fa39a3859b4119ca4043c386c9a143beb6 +size 413603200 diff --git a/Proto_Leech-3.2-1B.i1-IQ1_S.gguf b/Proto_Leech-3.2-1B.i1-IQ1_S.gguf new file mode 100644 index 0000000..3f7062a --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:244c22a1acc46e2a5ce7fbec72d9f10cca701d247142af3fb3978ebd75b986b6 +size 393549184 diff --git a/Proto_Leech-3.2-1B.i1-IQ2_M.gguf b/Proto_Leech-3.2-1B.i1-IQ2_M.gguf new file mode 100644 index 0000000..501d304 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c4da2955189ec80e8769c88b9b20d8ecd1e6ea780db4d53612b4e14af625c17 +size 515446144 diff --git a/Proto_Leech-3.2-1B.i1-IQ2_S.gguf b/Proto_Leech-3.2-1B.i1-IQ2_S.gguf new file mode 100644 index 0000000..f125b75 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99f3cc58e866b131ff64b43d454bb315489daf9a46c1a69c969801b14386e00f +size 488707456 diff --git a/Proto_Leech-3.2-1B.i1-IQ2_XS.gguf b/Proto_Leech-3.2-1B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..f41900b --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a41c222ed1048901963ec5c57ae5549c1b78e5e18a4f4be928df40b091703405 +size 475862400 diff --git a/Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf b/Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..e1fa14e --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11392e8e26f1ca10ada904f7ccafdc7d2ce1b505917d0683c5e106de79413dcc +size 447026560 diff --git a/Proto_Leech-3.2-1B.i1-IQ3_M.gguf b/Proto_Leech-3.2-1B.i1-IQ3_M.gguf new file mode 100644 index 0000000..68da745 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6a8d7fa7ab637c80c6ad4f1b3a1d6a9ed4f0c7c15603a791b12f881b2175f1c0 +size 657286528 diff --git a/Proto_Leech-3.2-1B.i1-IQ3_S.gguf b/Proto_Leech-3.2-1B.i1-IQ3_S.gguf new file mode 100644 index 0000000..5f124a9 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ed2890dc5f68b4a5d9b2a2eb2d656a9dd8d6e0f025f329728f46f98b4c9fd0f +size 643917184 diff --git a/Proto_Leech-3.2-1B.i1-IQ3_XS.gguf b/Proto_Leech-3.2-1B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..6c4e678 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3304c19ead70cfcc5df7f3362b1bc8b7ad493490ee3a3efbebd3fa25aebac78 +size 621110656 diff --git a/Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf b/Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..f516957 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b642bb12feaade27c2329b8928d18b23800e043c8d66a7b91af70911448843a0 +size 562107776 diff --git a/Proto_Leech-3.2-1B.i1-IQ4_NL.gguf b/Proto_Leech-3.2-1B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..d644362 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3212ed393db8133648ebd158746b5d4e3dc5ed7a8b19426885c9fb33d4aeed2b +size 773023104 diff --git a/Proto_Leech-3.2-1B.i1-IQ4_XS.gguf b/Proto_Leech-3.2-1B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..c6e8202 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b325616db721338a09c26f749e96be6b1a8e85129fa3c3550aba22d5514cc010 +size 743138688 diff --git a/Proto_Leech-3.2-1B.i1-Q2_K.gguf b/Proto_Leech-3.2-1B.i1-Q2_K.gguf new file mode 100644 index 0000000..e0a0e10 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02563086bc2d6f8a934f70b62d1f26fa61b057cd0beb02b88473082724e1785c +size 580871552 diff --git a/Proto_Leech-3.2-1B.i1-Q2_K_S.gguf b/Proto_Leech-3.2-1B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..f7064f4 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f45be40137efabe0ec67aeaecb514bbdda3deaf289a4f2f333170ef604e79b40 +size 554657152 diff --git a/Proto_Leech-3.2-1B.i1-Q3_K_L.gguf b/Proto_Leech-3.2-1B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..b259da2 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0a8379c4f58444500c211a62db3ea99c2b7b1337a8b650e94b88d1527f528b41 +size 732521856 diff --git a/Proto_Leech-3.2-1B.i1-Q3_K_M.gguf b/Proto_Leech-3.2-1B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..8cc9819 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f4ea3bb66e27371c4e1d4d5c0953630cb30471c2a901841c26a88ddf0bcc07f +size 690840960 diff --git a/Proto_Leech-3.2-1B.i1-Q3_K_S.gguf b/Proto_Leech-3.2-1B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..605b1c0 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3ba8ed8ac8dd83203fec7733d039cde0368ff464c596b3c287992ebace3c60b +size 641688960 diff --git a/Proto_Leech-3.2-1B.i1-Q4_0.gguf b/Proto_Leech-3.2-1B.i1-Q4_0.gguf new file mode 100644 index 0000000..ee2e4ce --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce39a388827c8cb75f278cdb2761dbc7b599901f625a9b436bda282152ac1e88 +size 773023104 diff --git a/Proto_Leech-3.2-1B.i1-Q4_1.gguf b/Proto_Leech-3.2-1B.i1-Q4_1.gguf new file mode 100644 index 0000000..a21f396 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bdf915f406c257341d024a7d0ecce80056a98cad9d0fa2730f18451689cf7f7d +size 831743360 diff --git a/Proto_Leech-3.2-1B.i1-Q4_K_M.gguf b/Proto_Leech-3.2-1B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..ede583f --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c997fcb54386b93ea8e85ab5d942caa3d0f782df5b69d5991ff62b48e266a5e7 +size 807691648 diff --git a/Proto_Leech-3.2-1B.i1-Q4_K_S.gguf b/Proto_Leech-3.2-1B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..f4d8e69 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0c39d57a0557e1f3741e8804e4cb429c4d0942e45430daf04c76b1701c840cc2 +size 775644544 diff --git a/Proto_Leech-3.2-1B.i1-Q5_K_M.gguf b/Proto_Leech-3.2-1B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..a002912 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:719c562ecc969989cc7315a10b27b1963d91e5c1339c00a9d9a601a317e641c0 +size 911500672 diff --git a/Proto_Leech-3.2-1B.i1-Q5_K_S.gguf b/Proto_Leech-3.2-1B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..114d3b4 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9cd4f1f9762f4bfa762393e1e529bc233734744752391c691888f1dbe76bf9ff +size 892560768 diff --git a/Proto_Leech-3.2-1B.i1-Q6_K.gguf b/Proto_Leech-3.2-1B.i1-Q6_K.gguf new file mode 100644 index 0000000..05725c5 --- /dev/null +++ b/Proto_Leech-3.2-1B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:681f0837937f944964b534fb3090d53c6efe688a00edb0fa7fee06cf169180ea +size 1021797760 diff --git a/Proto_Leech-3.2-1B.imatrix.gguf b/Proto_Leech-3.2-1B.imatrix.gguf new file mode 100644 index 0000000..a77edb3 --- /dev/null +++ b/Proto_Leech-3.2-1B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ec0a0d2081637e6f5a8dc21a724f9a3d08aca1c46987d0620f8bf2243a969fa +size 1328000 diff --git a/README.md b/README.md new file mode 100644 index 0000000..f895487 --- /dev/null +++ b/README.md @@ -0,0 +1,94 @@ +--- +base_model: UmbrellaInc/Proto_Leech-3.2-1B +language: +- en +- es +library_name: transformers +license: llama3.2 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- unestable? +- prototype +- experimental +- uncensored +- abliterated +- merge +- not-for-all-audiences +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/UmbrellaInc/Proto_Leech-3.2-1B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Proto_Leech-3.2-1B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.7 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.8 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +