commit 6d53dec83f10553defbaabf616566b090b61fc73 Author: ModelHub XC Date: Sat Jun 6 17:19:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..1f08ca6 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_M.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_M.gguf new file mode 100644 index 0000000..2b9f54c --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05282fe14b9d0f6433947cda3c8b35d482e3e95bee6205882e3b131f74c4bfb8 +size 7078292416 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_S.gguf new file mode 100644 index 0000000..487f7e7 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d2161d2fda8d5bde9c8e8860364a9b41ed142fb1d738a2ae496836275e5d6225 +size 6416509888 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_M.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_M.gguf new file mode 100644 index 0000000..ced1e41 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ddb992128a069d8cf285dc19a68e7e86199a483406d966dcdb206af3fa4d515e +size 10169508800 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_S.gguf new file mode 100644 index 0000000..fd28a33 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f7ca8713e753d61d10a1209095e810519efdbaefd5a92d15f137c1b28ed3f1af +size 9287132096 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XS.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XS.gguf new file mode 100644 index 0000000..8582610 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:afe51ecfc1a598f67dcd9ed6b8d859d3d85f8f0e6a357a41c8c98eece52487fc +size 9076222912 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..5570958 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b8aa73f5f9a56041f08b5b19017c13abb7a57586061a18403462ef6d4073f60 +size 8181263296 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_M.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_M.gguf new file mode 100644 index 0000000..08f0c77 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:490dd4f563fd052179025c5aad16229831263b2f2c0fbbe815361905403b4f7a +size 13513063360 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_S.gguf new file mode 100644 index 0000000..9854723 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:684b8a9e528477e40ed3db38b746c502101db97913d85de8cdd1ba4cc791c23e +size 13299153856 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XS.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XS.gguf new file mode 100644 index 0000000..c848be1 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09fa44f6dd6eac277cb2dd3a15a9ca609b5a392ba08a57c5287e52d9eed29382 +size 12598442944 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..b65da94 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2e1f167d6c038ed2b0edc03c9740190a07955a19ea580cd410d4858bfe82c84e +size 11849327552 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ4_XS.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ4_XS.gguf new file mode 100644 index 0000000..df23302 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e612d2a2e32718d1ce79b31fc69ecf5b20d59218f0f39317fd909eed05d91be8 +size 16368350144 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K.gguf new file mode 100644 index 0000000..4c67751 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e8eebd975f5dce97d8df092c3355f61f0262ec539f257ab5b76ef2b153529733 +size 11258610624 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K_S.gguf new file mode 100644 index 0000000..62d96f7 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f7afd4a8681678f1fdb27b04117ec69e88cdb4bc0ba34d976faae05e939d8b85 +size 10519364544 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_L.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_L.gguf new file mode 100644 index 0000000..9198a69 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e5d03ba2894ddc5ee56a6d0e91467e5c8a7de9a4a70b751f7fc361d489c4e5e +size 15900670912 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_M.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_M.gguf new file mode 100644 index 0000000..35c66cb --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7d3bb5dfe4b31c25f6cafd2c0fe971caffd4fb7dace14a3113b018f5cb5819ee +size 14711847872 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_S.gguf new file mode 100644 index 0000000..421d7de --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:807287fcdf225389de5a08164db895431a524ebf9c630d2713ee1be0bdaaaf2f +size 13292469184 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_0.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_0.gguf new file mode 100644 index 0000000..4524561 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:88d997c51953057065d702bc528631ed0139dc0fdde113f07bae3e04539cc653 +size 17379988416 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_1.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_1.gguf new file mode 100644 index 0000000..0bd4789 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7a3bcabbe97417988aa2f5fda7fbbabbdf5b35d7c14689d62f87e26f78071900 +size 19192501184 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_M.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_M.gguf new file mode 100644 index 0000000..918b0de --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3ea5a2f5bd544deac662917ea03e5ae645baf1ef59f6076dbf73b8e4b8355b0 +size 18556687296 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_S.gguf new file mode 100644 index 0000000..1149240 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd515c70c72ff5c2ac6ed128fdc37e0df0fe664b782820e922ba663387e164fb +size 17456010176 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_M.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_M.gguf new file mode 100644 index 0000000..e799e32 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9f1873d4e35c6bca45a53ab5eda4add067dd5b4017ede855bab19a4dbe3b0029 +size 21725582272 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_S.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3ec8e56 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90ed901c59cd53fbda079b2cf77255116144185e4672286c1d31786253339939 +size 21080511424 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q6_K.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q6_K.gguf new file mode 100644 index 0000000..34fa2c2 --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c97cdb0faafbca6cf81b040844dca604399b132c4d9df730412e74ea8d2d001c +size 25092533184 diff --git a/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.imatrix.gguf b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.imatrix.gguf new file mode 100644 index 0000000..d1158bb --- /dev/null +++ b/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:06467cb9822449b8fabd8411faddd41328402c67442ed573dd99b1794fc45b39 +size 122029312 diff --git a/README.md b/README.md new file mode 100644 index 0000000..70cd56a --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: huihui-ai/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated +language: +- en +library_name: transformers +license: apache-2.0 +license_link: https://huggingface.co/Qwen/Qwen3-30B-A3B-Instruct-2507/blob/main/LICENSE +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- abliterated +- uncensored +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/huihui-ai/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.imatrix.gguf) | imatrix | 0.2 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 6.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 7.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.3 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 9.2 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 9.4 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 10.3 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 10.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q2_K.gguf) | i1-Q2_K | 11.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 11.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 12.7 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 13.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 13.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 13.6 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 14.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 16.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 16.5 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 17.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 17.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 18.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 19.3 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 21.2 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 21.8 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated.i1-Q6_K.gguf) | i1-Q6_K | 25.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +