From a28ae548639b5f474331c5944bad4e8aac0b35fa Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Thu, 13 Aug 2026 05:55:16 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: mradermacher/NEXUS-Coder-Abliterated-i1-GGUF Source: Original Platform --- .gitattributes | 60 +++++++++++++++++ NEXUS-Coder-Abliterated.i1-IQ1_M.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ1_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ2_M.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ2_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ3_M.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ3_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf | 3 + NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q2_K.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q4_0.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q4_1.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf | 3 + NEXUS-Coder-Abliterated.i1-Q6_K.gguf | 3 + NEXUS-Coder-Abliterated.imatrix.gguf | 3 + README.md | 88 +++++++++++++++++++++++++ 27 files changed, 223 insertions(+) create mode 100644 .gitattributes create mode 100644 NEXUS-Coder-Abliterated.i1-IQ1_M.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ1_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ2_M.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ2_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ3_M.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ3_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q2_K.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q4_0.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q4_1.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf create mode 100644 NEXUS-Coder-Abliterated.i1-Q6_K.gguf create mode 100644 NEXUS-Coder-Abliterated.imatrix.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..4dde212 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-Abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/NEXUS-Coder-Abliterated.i1-IQ1_M.gguf b/NEXUS-Coder-Abliterated.i1-IQ1_M.gguf new file mode 100644 index 0000000..610d632 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e65422181e5a79214892de2fb14e2d24301e1f6f42c3b74ca6b076ecdfce231b +size 464461888 diff --git a/NEXUS-Coder-Abliterated.i1-IQ1_S.gguf b/NEXUS-Coder-Abliterated.i1-IQ1_S.gguf new file mode 100644 index 0000000..f7a7019 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:53fded5b1e7a11140e9a894fe6b422059db0ae2be2bc2d83f3fc318d2e6f23fc +size 436528192 diff --git a/NEXUS-Coder-Abliterated.i1-IQ2_M.gguf b/NEXUS-Coder-Abliterated.i1-IQ2_M.gguf new file mode 100644 index 0000000..a3cddba --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a9319b833107f1486d67ea3f8bc3db1e2c9f2c05333738a11856f59390c67f4f +size 601055296 diff --git a/NEXUS-Coder-Abliterated.i1-IQ2_S.gguf b/NEXUS-Coder-Abliterated.i1-IQ2_S.gguf new file mode 100644 index 0000000..39e12ec --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:463342b1002e980ff85ff086c06dbc6145799ae964897e04b760b6ad8cd0b5d9 +size 563810368 diff --git a/NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf b/NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf new file mode 100644 index 0000000..3d9259d --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9449e3cad74c121577e47585de2767704a23127e6322726295793c5422d0d610 +size 550327360 diff --git a/NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf b/NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..7eb5def --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99d63f7e0a9d59517fcf021c2850b91fefba6faa23addd90703954deba9bb3a7 +size 511018048 diff --git a/NEXUS-Coder-Abliterated.i1-IQ3_M.gguf b/NEXUS-Coder-Abliterated.i1-IQ3_M.gguf new file mode 100644 index 0000000..f9a700d --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e485279aced5499c3d9e3940065405ed69778c8599e427a87e94e9e70806c33 +size 776664640 diff --git a/NEXUS-Coder-Abliterated.i1-IQ3_S.gguf b/NEXUS-Coder-Abliterated.i1-IQ3_S.gguf new file mode 100644 index 0000000..d4ebb81 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e7977937a04b3abb6336cc545e8e2963988ef5048082734f58cf7f429b41e341 +size 762407488 diff --git a/NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf b/NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf new file mode 100644 index 0000000..ff027b9 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9e502866e5a5a3d0d4bdbc6f8a23e18d8cfbbdbb7e12f74e4d0c20de1684213d +size 731699776 diff --git a/NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf b/NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..7b100f7 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4371f59e3375d9d59ef1c5dfd9cdc7e3790e52173503a86d3c24a6cd9cd4208b +size 668792896 diff --git a/NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf b/NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf new file mode 100644 index 0000000..6745c76 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a695bce14241515bdc20ec9cc8a1b4f2f0b1cb6813222e7db0fc56295b9efddc +size 936331840 diff --git a/NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf b/NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf new file mode 100644 index 0000000..e5b24fc --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c1b643573621163267ed212246aa89008207a3c322e8ac98d86cc36e0d7b181 +size 895732288 diff --git a/NEXUS-Coder-Abliterated.i1-Q2_K.gguf b/NEXUS-Coder-Abliterated.i1-Q2_K.gguf new file mode 100644 index 0000000..5b1e77b --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c8ce618709f73a7e95fa2f6823b097861e351984f78e094e07bea082da6e8f9d +size 676305472 diff --git a/NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf b/NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf new file mode 100644 index 0000000..95185c2 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ca78fc61066eacfbb4313a597f6bc700c28dec9e5074fe4d538e04b54886213 +size 640135744 diff --git a/NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf b/NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf new file mode 100644 index 0000000..03d1289 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:83076918c1673c3c8fb409e26fa03095d64a5e891fee4722e8716d3ea3741d9c +size 880163392 diff --git a/NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf b/NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a37052d --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:addd4e6bb820de4d1203f9d9f37c6a6f1dbcaa2555302323569be1541730ee80 +size 824179264 diff --git a/NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf b/NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf new file mode 100644 index 0000000..a27a92c --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:87b429ff01459d0d98b443442a5ba2124f4612fae12d7433c135389ab50e45d9 +size 760945216 diff --git a/NEXUS-Coder-Abliterated.i1-Q4_0.gguf b/NEXUS-Coder-Abliterated.i1-Q4_0.gguf new file mode 100644 index 0000000..e4fe116 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7bb2f83c188ba7061d8cb036d2ac1b9b2a5803dbbd57a987f6174658f160f544 +size 937536064 diff --git a/NEXUS-Coder-Abliterated.i1-Q4_1.gguf b/NEXUS-Coder-Abliterated.i1-Q4_1.gguf new file mode 100644 index 0000000..1d6d47b --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f1fbdfc1031a3ebfd1b6ebf9f9440f7f53a7877885c6a8382bdcf9c2f9d9ceb9 +size 1016842816 diff --git a/NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf b/NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf new file mode 100644 index 0000000..1b0eac2 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ec15fa1748294bac0a8a6a2598d36cf86e10415625db43b4182570dd6792442f +size 986049088 diff --git a/NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf b/NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf new file mode 100644 index 0000000..aa51f1c --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f6cb31f2b08e44c90beb80c60e8b9d4f503c9bf390a914671d3a34059233be8 +size 940313152 diff --git a/NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf b/NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf new file mode 100644 index 0000000..a9a3b41 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fab4f54bb7f3f73bc8320ed57030e5af34aa76762586aba686f83277dc7d9a5a +size 1125050944 diff --git a/NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf b/NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3574d14 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:45fd23d4ffeb0b2d66bfcc71f6925e999a4b0afb30b26b0cf1d25208a4d0a5bf +size 1098730048 diff --git a/NEXUS-Coder-Abliterated.i1-Q6_K.gguf b/NEXUS-Coder-Abliterated.i1-Q6_K.gguf new file mode 100644 index 0000000..9ca2763 --- /dev/null +++ b/NEXUS-Coder-Abliterated.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bec763469dabe91dacbe8faff0dadbcc2586022763b7965f59da78e7bc0fe679 +size 1272740416 diff --git a/NEXUS-Coder-Abliterated.imatrix.gguf b/NEXUS-Coder-Abliterated.imatrix.gguf new file mode 100644 index 0000000..4fa2609 --- /dev/null +++ b/NEXUS-Coder-Abliterated.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08a3cb6e6e152b0d911cc1620cb4e200296b098b3130d70c896cbb5e5521b567 +size 2065888 diff --git a/README.md b/README.md new file mode 100644 index 0000000..2942889 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: usermma/NEXUS-Coder-Abliterated +language: en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- obliteratus +- abliteration +- uncensored +- obliterate +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/usermma/NEXUS-Coder-Abliterated + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#NEXUS-Coder-Abliterated-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +