commit 12f5aeb838e7fa0931a498f068ea0cd889eab2df Author: ModelHub XC Date: Wed May 13 17:08:20 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..3608ab6 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Goetia-24B-v1.2-absolute-heresy.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_M.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_M.gguf new file mode 100644 index 0000000..cd4e2d2 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7e32785b6a7a8a29411086b0dce0cb04cbaa78067906226b6dcdc886713927e +size 5750561120 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_S.gguf new file mode 100644 index 0000000..abd0c87 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:01f68697e205c846995ec3657c043812a36243d9d7fbb8e155a16a41bd20349d +size 5273786720 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_M.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_M.gguf new file mode 100644 index 0000000..f5c7468 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ad858be74a67b1fa80e767b868c55a2122b373c7d031ab12be87f0c345e5eeab +size 8114123200 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_S.gguf new file mode 100644 index 0000000..78c1db1 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2219cef6024b25cf3892523f03550ff02082d3a2e226e339a0c0d4c65d74db73 +size 7478424000 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XS.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XS.gguf new file mode 100644 index 0000000..3a76275 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4a1216851d0bcd628009f17b87148c5c7b3cd6f25bdb1e72ae7e8ae08daf5a73 +size 7207098720 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XXS.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..53ade4f --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ffc5050e71c09106d0523a514dbd076b2dea3b444b403b900e782d9d8217bd1 +size 6545185120 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_M.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_M.gguf new file mode 100644 index 0000000..f2f0ea5 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:138bfe051db10218318701c7893e9de3b9e86f014a999e839d402665d44bde90 +size 10651029920 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_S.gguf new file mode 100644 index 0000000..2c939e4 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04a4d7202b2688ebd80dcec388afb6d84058afcdafde880ee2d33742f302d0c4 +size 10428207520 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XS.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XS.gguf new file mode 100644 index 0000000..eda615e --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:abac1531aebf67801568a4f799a3451fa18ed98648c8087bbb761016323046d4 +size 9907196320 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XXS.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..82a9e88 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a13045ceab8451f58f0a48d80daaefab720ed2cd36f995e2237b2b4f6b9b7a81 +size 9280664000 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-IQ4_XS.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-IQ4_XS.gguf new file mode 100644 index 0000000..619efb0 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8903d5337e1c0783067cc64c7155858508bca3832bbb34181640a1e4787b0e8e +size 12759001600 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K.gguf new file mode 100644 index 0000000..d22cbb8 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f67223892eab2bf15e9bc911fe3c5685e72351fb0587447b92c7a6c07f3568f +size 8890399040 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K_S.gguf new file mode 100644 index 0000000..d11282f --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2a09f49150f8d8553480b2d0ef875c3a5f03945c58a8db61e524fdf370590bd +size 8320235840 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_L.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_L.gguf new file mode 100644 index 0000000..990d266 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e453f01226a8ea119b1ff83b5f3be361316cbab088de79e1cb45c9bb73e4001 +size 12400841120 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_M.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_M.gguf new file mode 100644 index 0000000..9a04910 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:abc0a9339c9552effa92a242de0302142ffe46ba6a1adda1cbeca613c6e506c0 +size 11474162080 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_S.gguf new file mode 100644 index 0000000..1db4277 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77dd3e209dc6a651b32765f692f1951f2c047ba2ea17732749e11d9e649156b4 +size 10400354720 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q4_0.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_0.gguf new file mode 100644 index 0000000..b904a64 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:101448734ae62457ce2526b1e897c93fc6d964b6c73c9e5e7fa8a8e92d62d4a7 +size 13494317440 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q4_1.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_1.gguf new file mode 100644 index 0000000..cd7a060 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fffeb48c9f75eed6345f53df3d909e4b8e814a08db1cfd99ec1b0af5ffdf93c8 +size 14873198720 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_M.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_M.gguf new file mode 100644 index 0000000..c14e305 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d15162fd1f3cf8deb6eaf8adc07f6d8f85b1fce3ce81aa15fca37d86e9309073 +size 14333997440 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_S.gguf new file mode 100644 index 0000000..2a8cdbb --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a502f60cab7f8255ba7ef0ceb0e11dcdfe1b255e00af7cecaf65329a5f598898 +size 13549367680 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_M.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0f85f61 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fa88c0388a73238ebdf17e6a192629c7d9d66ff2a97f460528906991143419aa +size 16764080000 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_S.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_S.gguf new file mode 100644 index 0000000..43f49bb --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1333a31874eb91733d94989373b9929760cdd12a6f04c3141bbc0b43e855527e +size 16304508800 diff --git a/Goetia-24B-v1.2-absolute-heresy.i1-Q6_K.gguf b/Goetia-24B-v1.2-absolute-heresy.i1-Q6_K.gguf new file mode 100644 index 0000000..c8a8300 --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d6e7ff82164b3329830201b03db2c5a93bd6306cb8f2869ffe0d4d6a68c7fbf8 +size 19346042720 diff --git a/Goetia-24B-v1.2-absolute-heresy.imatrix.gguf b/Goetia-24B-v1.2-absolute-heresy.imatrix.gguf new file mode 100644 index 0000000..27815aa --- /dev/null +++ b/Goetia-24B-v1.2-absolute-heresy.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7f2a446d12b1bb519938695acb38eb876965bd43e504f011612966d3da4685f6 +size 10037312 diff --git a/README.md b/README.md new file mode 100644 index 0000000..9690800 --- /dev/null +++ b/README.md @@ -0,0 +1,117 @@ +--- +base_model: MuXodious/Goetia-24B-v1.2-absolute-heresy +datasets: +- OccultAI/illuminati_imatrix_v1 +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- creative +- creative writing +- fiction writing +- plot generation +- sub-plot generation +- story generation +- scene continue +- storytelling +- fiction story +- science fiction +- romance +- all genres +- story +- writing +- vivid prosing +- vivid writing +- fiction +- roleplaying +- float32 +- swearing +- rp +- horror +- karcher +- mistral +- merge +- mergekit +- heretic +- uncensored +- decensored +- abliterated +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/MuXodious/Goetia-24B-v1.2-absolute-heresy + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Goetia-24B-v1.2-absolute-heresy-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | | +| [GGUF](https://huggingface.co/mradermacher/Goetia-24B-v1.2-absolute-heresy-i1-GGUF/resolve/main/Goetia-24B-v1.2-absolute-heresy.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +