commit 47d7bce0bf5a07b99d2d4ec416c486cec6c873a8 Author: ModelHub XC Date: Wed Aug 12 19:47:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..936946b --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +NEXUS-Coder-OBLITERATED.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ1_M.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ1_M.gguf new file mode 100644 index 0000000..775361b --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:570ec86399817ace64c95a3e174c82fbc9f39eb9a4782731088851e4a96ef116 +size 464461888 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ1_S.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ1_S.gguf new file mode 100644 index 0000000..82c78e1 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02d662bd3d4e50c6475d5a82603a44dfc673821c44344c7ad40e305d17cdf5ad +size 436528192 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ2_M.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ2_M.gguf new file mode 100644 index 0000000..e0bf3ee --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:29697b9a84564484521520901a27dd2fe8410ecbc5abeddab85219e7655b1deb +size 601055296 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ2_S.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ2_S.gguf new file mode 100644 index 0000000..bc12f57 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:254f97f5f80855caf88ecaac6bdcf37c51aed3eb161b04a4a2226296cb7a1d07 +size 563810368 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ2_XS.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ2_XS.gguf new file mode 100644 index 0000000..817313c --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17458f3130c32655c6bf0bf75be82151f5348ddbb40c846f3e57edbc469651fc +size 550327360 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ2_XXS.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..9da7f36 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:958ad9883e65ed8191b531bb66896c9bad783184c4ab9c238b5de37c9bb68c00 +size 511018048 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ3_M.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ3_M.gguf new file mode 100644 index 0000000..37f1d9a --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b363ce9a967836cab80ce2decf63bc990df7bfd6a254c7c5f8bb1c6651f59377 +size 776664640 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ3_S.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ3_S.gguf new file mode 100644 index 0000000..6c7a59c --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b136eae8f7d40617e55450f4851334992c8446e148aa7f1acfbe53f48827269f +size 762407488 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ3_XS.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ3_XS.gguf new file mode 100644 index 0000000..6083be0 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:483c1fd42feca1c13e478bc8c6bad000c186382affbf1ce8ca538996d11484fd +size 731699776 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ3_XXS.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..faf2eba --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a207039b5f4fe304f1f0bfa76f0b3b6e37d86981da2f34c8cb03d8c316aa2f1 +size 668792896 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ4_NL.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ4_NL.gguf new file mode 100644 index 0000000..1c49554 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17a13e4e8e3727604ce83e93dc9bd822a5cc8243b78c43b77a3ccacf2b03e026 +size 936331840 diff --git a/NEXUS-Coder-OBLITERATED.i1-IQ4_XS.gguf b/NEXUS-Coder-OBLITERATED.i1-IQ4_XS.gguf new file mode 100644 index 0000000..7c69c29 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5fd8bcc0996891ae3d55862ae7e42340ca332ce851bd8b5448c5e9bb1ff649fc +size 895732288 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q2_K.gguf b/NEXUS-Coder-OBLITERATED.i1-Q2_K.gguf new file mode 100644 index 0000000..c1a0cb5 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3bbedf8bebc57771de675affdb791d68ecbb55ac05d3f2a56bc36470850997c +size 676305472 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q2_K_S.gguf b/NEXUS-Coder-OBLITERATED.i1-Q2_K_S.gguf new file mode 100644 index 0000000..8ff933d --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c287c36f69031c3efc2714504c84127016d056ed72a0e96163eb2ec8688baec9 +size 640135744 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q3_K_L.gguf b/NEXUS-Coder-OBLITERATED.i1-Q3_K_L.gguf new file mode 100644 index 0000000..2170eef --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:87a2d2b8002ffee3d8c0cad0ebefdd22c328d996bee8e45f48ab690b410257cb +size 880163392 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q3_K_M.gguf b/NEXUS-Coder-OBLITERATED.i1-Q3_K_M.gguf new file mode 100644 index 0000000..f90c960 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:23fffb923f74d4a484922456c0a345ddc1a5e88dddc835cc9d63f0febd009876 +size 824179264 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q3_K_S.gguf b/NEXUS-Coder-OBLITERATED.i1-Q3_K_S.gguf new file mode 100644 index 0000000..7cf4547 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf058af19535f691f002fe0f36a15e7c74873c1f17b37eeccb4bfd28614171fe +size 760945216 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q4_0.gguf b/NEXUS-Coder-OBLITERATED.i1-Q4_0.gguf new file mode 100644 index 0000000..07ac057 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ddc327a490289d4942855dea3f4a72b5b487652a9e97f4f24fcce44f7c6c531c +size 937536064 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q4_1.gguf b/NEXUS-Coder-OBLITERATED.i1-Q4_1.gguf new file mode 100644 index 0000000..b20a299 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d919b9ff1becede932efc178464a88f8af766c7d5eb880822d283e1d27f06ad0 +size 1016842816 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q4_K_M.gguf b/NEXUS-Coder-OBLITERATED.i1-Q4_K_M.gguf new file mode 100644 index 0000000..df4d85c --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09ea447d537e4ff4c15e9b6c6f03c2dcd2a8b2c160d025ccf17796035b83205b +size 986049088 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q4_K_S.gguf b/NEXUS-Coder-OBLITERATED.i1-Q4_K_S.gguf new file mode 100644 index 0000000..528d61d --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9268839ef31ebfadae6d8b1195be33d574a3900a6f56988774cf03163e9609c9 +size 940313152 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q5_K_M.gguf b/NEXUS-Coder-OBLITERATED.i1-Q5_K_M.gguf new file mode 100644 index 0000000..255d709 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b02353821f7db9341436fe7626144d45ca690faef6a6d7a9fccaf668a0980bf +size 1125050944 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q5_K_S.gguf b/NEXUS-Coder-OBLITERATED.i1-Q5_K_S.gguf new file mode 100644 index 0000000..fee9e9d --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6efc96371607385db57b1613d7ea8917e53fc497cd38df376b445b11c19e9b67 +size 1098730048 diff --git a/NEXUS-Coder-OBLITERATED.i1-Q6_K.gguf b/NEXUS-Coder-OBLITERATED.i1-Q6_K.gguf new file mode 100644 index 0000000..a442809 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:049e9533bd791411b857c72bf34a7020dca6b98293f5080556ac0547e520cd3f +size 1272740416 diff --git a/NEXUS-Coder-OBLITERATED.imatrix.gguf b/NEXUS-Coder-OBLITERATED.imatrix.gguf new file mode 100644 index 0000000..1c12009 --- /dev/null +++ b/NEXUS-Coder-OBLITERATED.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2512740c38a776e952edb3cd18d0ac666aafdc7d82758fe17276adad80a82f1c +size 2065888 diff --git a/README.md b/README.md new file mode 100644 index 0000000..380bef7 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: Ngixdev/NEXUS-Coder-OBLITERATED +language: en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- obliteratus +- abliteration +- uncensored +- obliterate +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Ngixdev/NEXUS-Coder-OBLITERATED + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#NEXUS-Coder-OBLITERATED-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-OBLITERATED-i1-GGUF/resolve/main/NEXUS-Coder-OBLITERATED.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +