commit 5f9f85b12dcfd6e74da0aeab9442396d8ca6e447 Author: ModelHub XC Date: Thu May 14 06:03:38 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b1e60a3 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_M.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_M.gguf new file mode 100644 index 0000000..9e8c96e --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85c386798ba9fb313648cf4643ba4ca1497c5c419d4cf55ff5ae8e02fd6c197f +size 1989314304 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_S.gguf new file mode 100644 index 0000000..0fdda90 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:549554ed1f9d21af1300f21f469a4ea5648ba028707384d80953d68cb1f93ab1 +size 1846970112 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_M.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_M.gguf new file mode 100644 index 0000000..6d0fe2d --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07628fe0e733632f74988142d65b6fc6bf420fd3f6af62db08e03912c3749f33 +size 2722268928 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_S.gguf new file mode 100644 index 0000000..6350546 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0321d243063e51b31bd11de0ca49f2623972c2424dfea3753490f73d9e244f60 +size 2532476672 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XS.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XS.gguf new file mode 100644 index 0000000..45ff205 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:be167d662cf0c6d554a4d19f506eafe458558b40c70b8f2cd652cc06ac3281e2 +size 2433124096 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XXS.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..f428106 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:52d3e03d00319d86616bbd088ece7da2437facdf95f7f7d22ec213ce6aa76dbe +size 2226554624 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_M.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_M.gguf new file mode 100644 index 0000000..1e17c62 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a2216bf3130ef4c103300a63f14974e959e79109e3ee41c380d42ac03785d908 +size 3558811392 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_S.gguf new file mode 100644 index 0000000..c13ba6d --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e16c6f171670cd4936e495f7a37930c30a7d9b41d4aa01e2741a9e04870c14dc +size 3456313088 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XS.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XS.gguf new file mode 100644 index 0000000..383a0ce --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d689f8b2ab552f796eeb2741e83d16bb7a146edaee7f1ed171abe7ac13092286 +size 3292735232 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XXS.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..c8316e6 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dc196488893873db238e6bf023944e5202af2f1b9c58167f204aba1837894391 +size 3048900352 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_NL.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_NL.gguf new file mode 100644 index 0000000..6fbc8ca --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6a35cd3206a76fad06f42ebe1741ee9ed1b35d91fd81aa6389d9e241dd0bc90 +size 4382205696 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_XS.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_XS.gguf new file mode 100644 index 0000000..7a6dd0b --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49996f553aa4078fc9b64e4310973ebcd91db8cc728485ca4379fca5b66cb2e2 +size 4168296192 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K.gguf new file mode 100644 index 0000000..40bdd43 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1d77ce6a5603467603cd4739ce7093422742fdbe0bb583e5c06999e0a63e1e0e +size 3006473984 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K_S.gguf new file mode 100644 index 0000000..2fb253a --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c0efe785fa6532a4ba5885434ccd4280be5c3064b908f26b70f2f8ef5b0c9f92 +size 2816157440 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_L.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_L.gguf new file mode 100644 index 0000000..037ffa7 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df4a742b42ecea95af0ff1294ace79580029e8d45d42b38ff63be49c8a9a58d9 +size 4095944448 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_M.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_M.gguf new file mode 100644 index 0000000..64c38a1 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f20eebedbb67479fc5bf6fd5b23fd62ff389dc2ec21a6ea44d2daaff4138619c +size 3792905984 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_S.gguf new file mode 100644 index 0000000..28869d4 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:baeb951f13b3265b4695f2cc868f6be233b2169f614d864f8b29b97099d82c40 +size 3438487296 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_0.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_0.gguf new file mode 100644 index 0000000..4b77eda --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff5bc042892551c1668b3580587c4ebaf80d7c3afe5123d4e06a38a7fbafdff0 +size 4380108544 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_1.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_1.gguf new file mode 100644 index 0000000..68489ec --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1179f0c1ae7b2f217a4934a1b0efec77c14369dfe6d9ed1ab6f3c7ffbdd9ace9 +size 4801636096 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_M.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_M.gguf new file mode 100644 index 0000000..e590cb3 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f90c4e8c288657dc6cc9b3bcdce94d32ee4942788dff1086b12c20a82f3f7036 +size 4624951040 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_S.gguf new file mode 100644 index 0000000..77e3e70 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3e29e7b7c61243f2f9efd59bb351094218d27ac394f9a73e22ae706ad2f2eee6 +size 4396885760 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_M.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_M.gguf new file mode 100644 index 0000000..a97f3a5 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c491a9e039c0d2abf8c0cd36d547ade6979d8771a6b78171115d76a78b18a84 +size 5371537152 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_S.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_S.gguf new file mode 100644 index 0000000..8e7fe97 --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:688b79f4382bb435549cf08c9e7224e847e6d83a232a7bd694b54836c95aed5d +size 5237843712 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q6_K.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q6_K.gguf new file mode 100644 index 0000000..15fd76f --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:83b8ac0dfc341e107e3f9812b8315178e3044a86ec166e9ae201d6cfacbdca2e +size 6164784896 diff --git a/Huihui-Hunyuan-MT-Chimera-7B-abliterated.imatrix.gguf b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.imatrix.gguf new file mode 100644 index 0000000..33f211d --- /dev/null +++ b/Huihui-Hunyuan-MT-Chimera-7B-abliterated.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c1e36d7fbb3f04466753b98ebd3217361c309ceeb8c9ee961620bcb1fd70409e +size 5015200 diff --git a/README.md b/README.md new file mode 100644 index 0000000..c48c941 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: huihui-ai/Huihui-Hunyuan-MT-Chimera-7B-abliterated +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- translation +- abliterated +- uncensored +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/huihui-ai/Huihui-Hunyuan-MT-Chimera-7B-abliterated + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 1.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 4.9 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | | +| [GGUF](https://huggingface.co/mradermacher/Huihui-Hunyuan-MT-Chimera-7B-abliterated-i1-GGUF/resolve/main/Huihui-Hunyuan-MT-Chimera-7B-abliterated.i1-Q6_K.gguf) | i1-Q6_K | 6.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +