commit 37f7205b4a6d4eb17b163c95c0c368b4cd4801c8 Author: ModelHub XC Date: Sat May 30 22:55:20 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..bd4c1e0 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_M.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_M.gguf new file mode 100644 index 0000000..88c3d06 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:921b1fc07f0f76a56c5cdd00cda04c5c017d1b7d757d9b27033f75b595a5bd69 +size 5750496800 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_S.gguf new file mode 100644 index 0000000..eca647d --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7d8328f2a0de6cf320b7df068682168c76b745a3238a87bd152ca9acfb1afbe +size 5273722400 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_M.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_M.gguf new file mode 100644 index 0000000..cef339b --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6a802da93a602cd49ff34d3f184e4f3c057b692ea1b4c73041d46d2e0dd65548 +size 8114052640 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_S.gguf new file mode 100644 index 0000000..918c096 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0a5b4bc0e1489572f149079954080cd3a72f2e8f56991ef850f3314fe12e6930 +size 7478353440 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XS.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XS.gguf new file mode 100644 index 0000000..219523d --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c62bff00d506ba9a0698d694c650827ed649e3cdb68ddced48ef05907d0dcac4 +size 7207034400 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XXS.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..944556f --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9231ae79ce8369b56bf13e944dd2a420272b5bf67e01089764191de62381809 +size 6545120800 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_M.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_M.gguf new file mode 100644 index 0000000..2126e0e --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e78fd3bf401a451825646f50026e6533b849f876e44ba5137b90829e07edb55a +size 10650951200 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_S.gguf new file mode 100644 index 0000000..9c823e4 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:504fa01d55de9f8063b19843b68ce6abb471552cf108c7633d13e9cccd407404 +size 10428128800 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XS.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XS.gguf new file mode 100644 index 0000000..39899cc --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe41d609e706aa1a586943e771157b07c893fb28b2e93001426775763beaa41f +size 9907117600 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XXS.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..783cd19 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fa939d1eb45a7de0a3a29b5deeaba3daa953eece8fb834eff948d949462ae24c +size 9280593440 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ4_XS.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ4_XS.gguf new file mode 100644 index 0000000..c1c4fd3 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f0dc584fcae5488a9610a4b8407568566849b2065d2c8ecbea5091d3fbe79a46 +size 12758916640 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K.gguf new file mode 100644 index 0000000..f68f35c --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:076ec52c5627f6e4e3a345d222165bb32171ce1708f38b28697cea136de66eda +size 8890326560 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K_S.gguf new file mode 100644 index 0000000..d550584 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61cba4bfbb473883565cf15cc947a835169e35c7ad0fbd3aee72becaba73e9e0 +size 8320163360 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_L.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_L.gguf new file mode 100644 index 0000000..c20e28b --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:becfce721a66ad78c4b336c9f43e7c590d353eb350eabd7e831497228af40da5 +size 12400762400 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_M.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_M.gguf new file mode 100644 index 0000000..f0fe069 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba5d92e4c9cc0725d45a45302c7b4f315a318d9d43b21e2dc354c25b35fafd68 +size 11474083360 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_S.gguf new file mode 100644 index 0000000..3d47837 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1aa977bd29616b21b55cc16a0acc6ed8648a94464e59623056897a75e0d99dea +size 10400276000 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_0.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_0.gguf new file mode 100644 index 0000000..ad11390 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b3c04b1a1349a1d8a8c2129d862018fb459405bf1597ca77f96f50a3b1a545ff +size 13494230560 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_1.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_1.gguf new file mode 100644 index 0000000..e847b03 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:41d0dbf6d2ef02c29a96febc924c549b8c5025dc417613d6e31392e3fe0e76fb +size 14873108000 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_M.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_M.gguf new file mode 100644 index 0000000..8715025 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b13ad0973823e517c5f82581c4abb4f7c58fd146aeb092e8417645faa93af5fb +size 14333910560 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_S.gguf new file mode 100644 index 0000000..c75f219 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:de6d25956fd7ea29fb99280cd4cac71d964b67f6b27f454aee0caf63fbe70164 +size 13549280800 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_M.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_M.gguf new file mode 100644 index 0000000..8467d3b --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c472727f22f49a9cbdfdce69ae440d17eff66d2540f4ed0a3063d64630907ec +size 16763985440 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_S.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_S.gguf new file mode 100644 index 0000000..c06b4c5 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:13e8a95abafbec5bcfb29184610beb6575ed6e73a3a154e67b14ca9810836253 +size 16304414240 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q6_K.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q6_K.gguf new file mode 100644 index 0000000..0c3195b --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d426677722dc191f73e4d95ea49487717a163deab6b2c9be90d9a2f2737c781 +size 19345940000 diff --git a/MistralAI-Magistral-Small-2507-Heretic-Uncensored.imatrix.gguf b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.imatrix.gguf new file mode 100644 index 0000000..6745c59 --- /dev/null +++ b/MistralAI-Magistral-Small-2507-Heretic-Uncensored.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:86d2ad7707cea5d43be82d87d4cdf264dc18c27748a8d183bbd318eec7f030d2 +size 10037312 diff --git a/README.md b/README.md new file mode 100644 index 0000000..337260f --- /dev/null +++ b/README.md @@ -0,0 +1,93 @@ +--- +base_model: Silicone-Moss/MistralAI-Magistral-Small-2507-Heretic-Uncensored +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- ablation +- research +- nlp +- 24b +- mistral +- heretic +- magistral +- roleplay +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Silicone-Moss/MistralAI-Magistral-Small-2507-Heretic-Uncensored + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | | +| [GGUF](https://huggingface.co/mradermacher/MistralAI-Magistral-Small-2507-Heretic-Uncensored-i1-GGUF/resolve/main/MistralAI-Magistral-Small-2507-Heretic-Uncensored.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +