commit b8c6d339aa3911462ab2eac4b4c16834a8ea2905 Author: ModelHub XC Date: Sun May 17 03:36:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Mini-mistral-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..4733de7 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Mini-mistral.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Mini-mistral.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Mini-mistral.i1-IQ1_M.gguf b/Mini-mistral.i1-IQ1_M.gguf new file mode 100644 index 0000000..507939a --- /dev/null +++ b/Mini-mistral.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd68a9ff508828c44eb9a88217e9f7ae09c53461a813e2fdb97bc1de1c3af114 +size 289702048 diff --git a/Mini-mistral.i1-IQ1_S.gguf b/Mini-mistral.i1-IQ1_S.gguf new file mode 100644 index 0000000..77ac5a3 --- /dev/null +++ b/Mini-mistral.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b74de483eb26a31327b1cecc1220e6dd67dcf0b85e4f43d31e3302e144e5ad0c +size 269967520 diff --git a/Mini-mistral.i1-IQ2_M.gguf b/Mini-mistral.i1-IQ2_M.gguf new file mode 100644 index 0000000..fab3239 --- /dev/null +++ b/Mini-mistral.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85ae9bcb418f727f74acbbbeefcc5e42363b74bf014a8226c02a1342f1ee7f86 +size 400076960 diff --git a/Mini-mistral.i1-IQ2_S.gguf b/Mini-mistral.i1-IQ2_S.gguf new file mode 100644 index 0000000..18d0407 --- /dev/null +++ b/Mini-mistral.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:edeb7effb50b7dd1e4b0ea0c6e38fae11069bcdb30b56abf9d92e9c586a8a77c +size 373764256 diff --git a/Mini-mistral.i1-IQ2_XS.gguf b/Mini-mistral.i1-IQ2_XS.gguf new file mode 100644 index 0000000..4e5e6a3 --- /dev/null +++ b/Mini-mistral.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ac2e1737b106d152d2d9b01532f11192cf144804c97fce0f02a05e39b561da6 +size 351789216 diff --git a/Mini-mistral.i1-IQ2_XXS.gguf b/Mini-mistral.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..5e19414 --- /dev/null +++ b/Mini-mistral.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37936fea424caf009667dfb07c1e47afe1cf48e4ffbd436779f2e141a87a5142 +size 322592928 diff --git a/Mini-mistral.i1-IQ3_M.gguf b/Mini-mistral.i1-IQ3_M.gguf new file mode 100644 index 0000000..8f21757 --- /dev/null +++ b/Mini-mistral.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3b2c8546646699c29815900748f4df07eddfaccf0d6594f530248e558a50556f +size 516194464 diff --git a/Mini-mistral.i1-IQ3_S.gguf b/Mini-mistral.i1-IQ3_S.gguf new file mode 100644 index 0000000..96d46b5 --- /dev/null +++ b/Mini-mistral.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4f76db52e49264f4bf1d62fa16660ae7cede71ef51e799dc68b928a8dc6e7291 +size 500875424 diff --git a/Mini-mistral.i1-IQ3_XS.gguf b/Mini-mistral.i1-IQ3_XS.gguf new file mode 100644 index 0000000..2975428 --- /dev/null +++ b/Mini-mistral.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ce984f1f205071b404727fa20dd85dbb38038f8a9fba373025588fa2c96c8ee +size 477626528 diff --git a/Mini-mistral.i1-IQ3_XXS.gguf b/Mini-mistral.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..1454624 --- /dev/null +++ b/Mini-mistral.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c8faa645d63c34063b4322c51155c4bf679abfd68b97d4ba8777d2499e007c84 +size 445132960 diff --git a/Mini-mistral.i1-IQ4_NL.gguf b/Mini-mistral.i1-IQ4_NL.gguf new file mode 100644 index 0000000..fead9e5 --- /dev/null +++ b/Mini-mistral.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4a37f437f352a24311853ffbbf19422841eb3586fdfbe03c0b477d657bb77358 +size 638169248 diff --git a/Mini-mistral.i1-IQ4_XS.gguf b/Mini-mistral.i1-IQ4_XS.gguf new file mode 100644 index 0000000..ca01ed8 --- /dev/null +++ b/Mini-mistral.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:86483d3b9e1704ff46aa02d7d4d815e90b0296453a0a8175b4eba40ae24571ef +size 606204064 diff --git a/Mini-mistral.i1-Q2_K.gguf b/Mini-mistral.i1-Q2_K.gguf new file mode 100644 index 0000000..be28196 --- /dev/null +++ b/Mini-mistral.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5eb9cd613c2673fc682afcb35de26579c16bddf11fb4de110c8e4adaf3d887f3 +size 432132256 diff --git a/Mini-mistral.i1-Q2_K_S.gguf b/Mini-mistral.i1-Q2_K_S.gguf new file mode 100644 index 0000000..1cfff83 --- /dev/null +++ b/Mini-mistral.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:540794d388ce3c7b43dc70e2abf0f5362cf8caf491a7b0f2058a32f1d4524791 +size 402395296 diff --git a/Mini-mistral.i1-Q3_K_L.gguf b/Mini-mistral.i1-Q3_K_L.gguf new file mode 100644 index 0000000..e5e9b6f --- /dev/null +++ b/Mini-mistral.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c4abdc2e831f6eca47c18e9926aced53a25ea5ee6b1cce7df92049c7fbe26b9 +size 591528096 diff --git a/Mini-mistral.i1-Q3_K_M.gguf b/Mini-mistral.i1-Q3_K_M.gguf new file mode 100644 index 0000000..f820a5b --- /dev/null +++ b/Mini-mistral.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6d03b3932c9808afa09aa974ca55275cad7053db015a932a2c9f130776874266 +size 548405408 diff --git a/Mini-mistral.i1-Q3_K_S.gguf b/Mini-mistral.i1-Q3_K_S.gguf new file mode 100644 index 0000000..ec49e16 --- /dev/null +++ b/Mini-mistral.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:279b1bfa061a4e17aafb440066c7b3c86ad9c223781e1ab4716bd0ce1c6e77cb +size 499343520 diff --git a/Mini-mistral.i1-Q4_0.gguf b/Mini-mistral.i1-Q4_0.gguf new file mode 100644 index 0000000..37b6847 --- /dev/null +++ b/Mini-mistral.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f87ccfc1cb60709203f382c2d30e46cd960cbf8bcd0e602225ec58ceee152e6c +size 638169248 diff --git a/Mini-mistral.i1-Q4_1.gguf b/Mini-mistral.i1-Q4_1.gguf new file mode 100644 index 0000000..3b3dc33 --- /dev/null +++ b/Mini-mistral.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:96c7e0ec5c66a126a57a7259c23b677c34deaa8a41f11920b01101d344fbdef4 +size 701378720 diff --git a/Mini-mistral.i1-Q4_K_M.gguf b/Mini-mistral.i1-Q4_K_M.gguf new file mode 100644 index 0000000..fbf7c41 --- /dev/null +++ b/Mini-mistral.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d4fa811090d192339ecc616392e610b789bec0bd4a2816f6a36c0e80d17e6f6f +size 667816096 diff --git a/Mini-mistral.i1-Q4_K_S.gguf b/Mini-mistral.i1-Q4_K_S.gguf new file mode 100644 index 0000000..8875df9 --- /dev/null +++ b/Mini-mistral.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6aa3e277b4dd6b11a6310d11d9dc29b9226e580176d869b1d76fcfe8cb21c3d8 +size 639873184 diff --git a/Mini-mistral.i1-Q5_K_M.gguf b/Mini-mistral.i1-Q5_K_M.gguf new file mode 100644 index 0000000..5b3ae0c --- /dev/null +++ b/Mini-mistral.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02894bb2aae578349c8ae40d4294911eab6c91b9d0719f16a57bcab6824c5944 +size 782045344 diff --git a/Mini-mistral.i1-Q5_K_S.gguf b/Mini-mistral.i1-Q5_K_S.gguf new file mode 100644 index 0000000..b815279 --- /dev/null +++ b/Mini-mistral.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:45b353a56ccd435896c80d44e20378ea12903f8d571bf76a746c4cc74bae7e2a +size 766029984 diff --git a/Mini-mistral.i1-Q6_K.gguf b/Mini-mistral.i1-Q6_K.gguf new file mode 100644 index 0000000..34cd1a9 --- /dev/null +++ b/Mini-mistral.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:437be8a9d939cdbced542cf704b7dadab6f590de12da41511c02480bce4be192 +size 903413920 diff --git a/Mini-mistral.imatrix.gguf b/Mini-mistral.imatrix.gguf new file mode 100644 index 0000000..4c09940 --- /dev/null +++ b/Mini-mistral.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1031af72a07095a6d634b6c84c808f3b30bc72b8028b604475cec42e16f6235 +size 1600704 diff --git a/README.md b/README.md new file mode 100644 index 0000000..75c91f2 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: RAANA-IA/Mini-mistral-1.0 +language: +- en +library_name: transformers +license: other +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- LLM +- MINI-MISTRAL +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/RAANA-IA/Mini-mistral-1.0 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mini-mistral-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Mini-mistral-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.5 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q2_K.gguf) | i1-Q2_K | 0.5 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_S.gguf) | i1-IQ3_S | 0.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_M.gguf) | i1-IQ3_M | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.7 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_0.gguf) | i1-Q4_0 | 0.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_1.gguf) | i1-Q4_1 | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q6_K.gguf) | i1-Q6_K | 1.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +