commit 0a60a1b9c400ee441f5390cae35c03480fefa427 Author: ModelHub XC Date: Fri May 15 03:06:45 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Mini-Mistral-1.0-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..a988694 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-Mistral-1.0.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Mini-Mistral-1.0.i1-IQ1_M.gguf b/Mini-Mistral-1.0.i1-IQ1_M.gguf new file mode 100644 index 0000000..4951dde --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:052bf273919acb4297e706bff309c362874f6b3d5df2bfdf86ac337bb4b6dcea +size 289702144 diff --git a/Mini-Mistral-1.0.i1-IQ1_S.gguf b/Mini-Mistral-1.0.i1-IQ1_S.gguf new file mode 100644 index 0000000..71e6282 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b2f3dd5da4782d8812a66c9c9c40e1e389bc1387dfc33260f415e50091e22cf +size 269967616 diff --git a/Mini-Mistral-1.0.i1-IQ2_M.gguf b/Mini-Mistral-1.0.i1-IQ2_M.gguf new file mode 100644 index 0000000..848000d --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d5e1130b3cdcc97076406a4a56b6dc34cb7689bffa94a1a2baf02e77f031a8e +size 400077056 diff --git a/Mini-Mistral-1.0.i1-IQ2_S.gguf b/Mini-Mistral-1.0.i1-IQ2_S.gguf new file mode 100644 index 0000000..bbaa6bb --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24b13e67681fb24b8ef38d887e251f95543f84e4a17df692329391cefd795702 +size 373764352 diff --git a/Mini-Mistral-1.0.i1-IQ2_XS.gguf b/Mini-Mistral-1.0.i1-IQ2_XS.gguf new file mode 100644 index 0000000..9fba249 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d20b2a24cb03c99bbad05394e024003f04656c79f4a46e0332b8c15cb9b6d99c +size 351789312 diff --git a/Mini-Mistral-1.0.i1-IQ2_XXS.gguf b/Mini-Mistral-1.0.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..d61b671 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d7ddc9182d04f27cd782fe74168042c586c88394230c176d622ab47452514b10 +size 322593024 diff --git a/Mini-Mistral-1.0.i1-IQ3_M.gguf b/Mini-Mistral-1.0.i1-IQ3_M.gguf new file mode 100644 index 0000000..0c376d8 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1fa5060076790008f2c1ec2d5500768fa87fc7fd0c259a41af607a7e86611db8 +size 516194560 diff --git a/Mini-Mistral-1.0.i1-IQ3_S.gguf b/Mini-Mistral-1.0.i1-IQ3_S.gguf new file mode 100644 index 0000000..ecb99cb --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d41bbb3756a69870cef7633314e196e3531cc420e646fc1cbb07d3bf62b35532 +size 500875520 diff --git a/Mini-Mistral-1.0.i1-IQ3_XS.gguf b/Mini-Mistral-1.0.i1-IQ3_XS.gguf new file mode 100644 index 0000000..aefa3c3 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:472a574c2fd44fa38bec21b77fac334f7d36a10fb73c5ec61a94542394add209 +size 477626624 diff --git a/Mini-Mistral-1.0.i1-IQ3_XXS.gguf b/Mini-Mistral-1.0.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..70d7228 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4165704432e7d9ecf2d220c204c7659c3fd83614fce56200bc189579fc9f0802 +size 445133056 diff --git a/Mini-Mistral-1.0.i1-IQ4_NL.gguf b/Mini-Mistral-1.0.i1-IQ4_NL.gguf new file mode 100644 index 0000000..188606a --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08167f7899680a49255328edf04025805dfa72ddd26e685f4a61dc94f55df0e8 +size 638169344 diff --git a/Mini-Mistral-1.0.i1-IQ4_XS.gguf b/Mini-Mistral-1.0.i1-IQ4_XS.gguf new file mode 100644 index 0000000..9b7f115 --- /dev/null +++ b/Mini-Mistral-1.0.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f91f0fc5d31e18b1004be8a02cad915ce40fd24272092097f13b5df62f22278d +size 606204160 diff --git a/Mini-Mistral-1.0.i1-Q2_K.gguf b/Mini-Mistral-1.0.i1-Q2_K.gguf new file mode 100644 index 0000000..6607cab --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16c9da4da4152b7e0f3d676ba69f204886a88be6ea4a42249eff50e5556b35c3 +size 432132352 diff --git a/Mini-Mistral-1.0.i1-Q2_K_S.gguf b/Mini-Mistral-1.0.i1-Q2_K_S.gguf new file mode 100644 index 0000000..4fc118f --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c614c2c8945cf88d4fb6a2a2c3a69157df31df502646d71964abde55f8bbccea +size 402395392 diff --git a/Mini-Mistral-1.0.i1-Q3_K_L.gguf b/Mini-Mistral-1.0.i1-Q3_K_L.gguf new file mode 100644 index 0000000..0d20834 --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5744082c311dacb14b41165efd94fcf25daa5609daa304df0aee0a89574a8ba9 +size 591528192 diff --git a/Mini-Mistral-1.0.i1-Q3_K_M.gguf b/Mini-Mistral-1.0.i1-Q3_K_M.gguf new file mode 100644 index 0000000..c84da1e --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7a58978912c3fb9fa89a8c07865f09a801f0a2b6902a318a6cdcbd127279736d +size 548405504 diff --git a/Mini-Mistral-1.0.i1-Q3_K_S.gguf b/Mini-Mistral-1.0.i1-Q3_K_S.gguf new file mode 100644 index 0000000..561fd49 --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2dfa5b18bc9686ca41fbb5581490313486ee97bdf57faa1ef0249f31fc1239b4 +size 499343616 diff --git a/Mini-Mistral-1.0.i1-Q4_0.gguf b/Mini-Mistral-1.0.i1-Q4_0.gguf new file mode 100644 index 0000000..17973ba --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:130f821693c286b5a58f8379aa3a43e72295c24316251a491026841f7fe59768 +size 638169344 diff --git a/Mini-Mistral-1.0.i1-Q4_1.gguf b/Mini-Mistral-1.0.i1-Q4_1.gguf new file mode 100644 index 0000000..d698ebe --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77df5f72256e25832135a43eabd0766f32f394c68fee0927b502835ca9dabbd1 +size 701378816 diff --git a/Mini-Mistral-1.0.i1-Q4_K_M.gguf b/Mini-Mistral-1.0.i1-Q4_K_M.gguf new file mode 100644 index 0000000..1a66886 --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a74ecebff803d0305afb0b526119bf042f2a0429906da267a07c4649bcc098a8 +size 667816192 diff --git a/Mini-Mistral-1.0.i1-Q4_K_S.gguf b/Mini-Mistral-1.0.i1-Q4_K_S.gguf new file mode 100644 index 0000000..d25d96b --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a870a26b2fd6aaa4b064834f704dc4fa676c4cffa46f0b18620cb736b0150d8 +size 639873280 diff --git a/Mini-Mistral-1.0.i1-Q5_K_M.gguf b/Mini-Mistral-1.0.i1-Q5_K_M.gguf new file mode 100644 index 0000000..c579340 --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4fef830b551e70bbbc12cdd50736db19f4ba79fe9525f517bfe4295111ddcdb +size 782045440 diff --git a/Mini-Mistral-1.0.i1-Q5_K_S.gguf b/Mini-Mistral-1.0.i1-Q5_K_S.gguf new file mode 100644 index 0000000..07b053d --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:26a5cfba0c804643cc5edef7079a6f6e5928d534532d0f13bfb591b1cc5cd3f8 +size 766030080 diff --git a/Mini-Mistral-1.0.i1-Q6_K.gguf b/Mini-Mistral-1.0.i1-Q6_K.gguf new file mode 100644 index 0000000..4ed0960 --- /dev/null +++ b/Mini-Mistral-1.0.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc20a46b2d20263a3cf009626f18dbcb28d78bec10e69a7007991b78dc955b09 +size 903414016 diff --git a/Mini-Mistral-1.0.imatrix.gguf b/Mini-Mistral-1.0.imatrix.gguf new file mode 100644 index 0000000..4c09940 --- /dev/null +++ b/Mini-Mistral-1.0.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1031af72a07095a6d634b6c84c808f3b30bc72b8028b604475cec42e16f6235 +size 1600704 diff --git a/README.md b/README.md new file mode 100644 index 0000000..09401bf --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: RAANA-IA/Mini-mistral-1.0 +language: +- en +library_name: transformers +license: other +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- LLM +- MINI-MISTRAL +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/RAANA-IA/Mini-mistral-1.0 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mini-Mistral-1.0-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Mini-Mistral-1.0-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.5 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q2_K.gguf) | i1-Q2_K | 0.5 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ3_S.gguf) | i1-IQ3_S | 0.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ3_M.gguf) | i1-IQ3_M | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.7 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q4_0.gguf) | i1-Q4_0 | 0.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q4_1.gguf) | i1-Q4_1 | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-Mistral-1.0-i1-GGUF/resolve/main/Mini-Mistral-1.0.i1-Q6_K.gguf) | i1-Q6_K | 1.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +