commit 72d030c2d7af9614a0ff8642769bbfe179c30016 Author: ModelHub XC Date: Thu Jul 9 23:46:13 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/DarkIdol-Aria-12B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..94d890f --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Aria-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/DarkIdol-Aria-12B.i1-IQ1_M.gguf b/DarkIdol-Aria-12B.i1-IQ1_M.gguf new file mode 100644 index 0000000..0234fa2 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e0f7624674dfa27b6eef59774f6f40a79f6c8d749625ddc983c0c056958092c +size 3164729152 diff --git a/DarkIdol-Aria-12B.i1-IQ1_S.gguf b/DarkIdol-Aria-12B.i1-IQ1_S.gguf new file mode 100644 index 0000000..091b8e6 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e1db381d8a1de3416dd872bf149ab022f00092ba3c0de374640b04ab9a644fc +size 2947415872 diff --git a/DarkIdol-Aria-12B.i1-IQ2_M.gguf b/DarkIdol-Aria-12B.i1-IQ2_M.gguf new file mode 100644 index 0000000..a3037db --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a4210a8caee7cd7ff1349049e0c5acae6f5941cb30babae0322252977a833ffb +size 4310462272 diff --git a/DarkIdol-Aria-12B.i1-IQ2_S.gguf b/DarkIdol-Aria-12B.i1-IQ2_S.gguf new file mode 100644 index 0000000..6f2efc5 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c62aa2f78f40cb806c3b42e24c2dfb3c6b59167a2cfc320dbc3228a626e54ec +size 4020711232 diff --git a/DarkIdol-Aria-12B.i1-IQ2_XS.gguf b/DarkIdol-Aria-12B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..4b38c25 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b0c73bc2abef494933f3a170d536ea017cbf9d9839be73dc7017c440807b8694 +size 3840261952 diff --git a/DarkIdol-Aria-12B.i1-IQ2_XXS.gguf b/DarkIdol-Aria-12B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..eea8cd0 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7db81e63381ee259ab5573f6289ae8b15e9596e863352ab8ca28e6c91c0baff8 +size 3526917952 diff --git a/DarkIdol-Aria-12B.i1-IQ3_M.gguf b/DarkIdol-Aria-12B.i1-IQ3_M.gguf new file mode 100644 index 0000000..9be9029 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f0180f093776e731636e999356e2e6261bb41e258710b163e99901bba157095 +size 5655723712 diff --git a/DarkIdol-Aria-12B.i1-IQ3_S.gguf b/DarkIdol-Aria-12B.i1-IQ3_S.gguf new file mode 100644 index 0000000..e3d5021 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8a5a4501bcf31cd4d3add094b9198381a300cc42b983acd599ac17f14f22d73a +size 5458316992 diff --git a/DarkIdol-Aria-12B.i1-IQ3_XS.gguf b/DarkIdol-Aria-12B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..bff364f --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a23fa99602e56df8cc12ed3aef335b00bd65a6d3e3829e4e8b4d8800c0373c80 +size 5206167232 diff --git a/DarkIdol-Aria-12B.i1-IQ3_XXS.gguf b/DarkIdol-Aria-12B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..6beb7d8 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:963ef67ec6a7a3b418bedb94e56348c5b8d4c185fd9c4ef1eacc635aae8f93ca +size 4784901952 diff --git a/DarkIdol-Aria-12B.i1-IQ4_NL.gguf b/DarkIdol-Aria-12B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..1c2e3f0 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c264bc5250f1e1db6ae914b4a3a9fdd5b0a91a0da8e261374de01b4b801bb457 +size 6887165632 diff --git a/DarkIdol-Aria-12B.i1-IQ4_XS.gguf b/DarkIdol-Aria-12B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0728697 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c62ad9f5cbb94c7e05712f78c833557022c6ee1c5137f38c9ed4a5a8993b5962 +size 6550965952 diff --git a/DarkIdol-Aria-12B.i1-Q2_K.gguf b/DarkIdol-Aria-12B.i1-Q2_K.gguf new file mode 100644 index 0000000..442d56a --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:612ddb9ce57e266107258418e9786c3210da6d59dd43ea83bf616dfcc1e21a4c +size 4768222912 diff --git a/DarkIdol-Aria-12B.i1-Q2_K_S.gguf b/DarkIdol-Aria-12B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..0ea29af --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4cf7736ed5a512d54eade43766eaeeacd2b2fbf1c440dff22df2eb9c751cecb +size 4448612032 diff --git a/DarkIdol-Aria-12B.i1-Q3_K_L.gguf b/DarkIdol-Aria-12B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..e525299 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6dc9575bf4efed19aaee68254e695389078a2e043cb2345494057387f1fc86d2 +size 6480187072 diff --git a/DarkIdol-Aria-12B.i1-Q3_K_M.gguf b/DarkIdol-Aria-12B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..c0de5dc --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0fc2645f673e644961d63b18440883bd74cd07bc985d3aa7b1e7a92f9cbcd558 +size 6008819392 diff --git a/DarkIdol-Aria-12B.i1-Q3_K_S.gguf b/DarkIdol-Aria-12B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..ed9b65a --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2554042617a0918b08f1bfe7161895c89fe89a72dd97ae5a61c89c176103fd6 +size 5458316992 diff --git a/DarkIdol-Aria-12B.i1-Q4_0.gguf b/DarkIdol-Aria-12B.i1-Q4_0.gguf new file mode 100644 index 0000000..2e6ddf9 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5605788c5e9a5ef4a8f43fa86f40fc028ea659e5ed9db0462b6d2d84f55c667a +size 6909284032 diff --git a/DarkIdol-Aria-12B.i1-Q4_1.gguf b/DarkIdol-Aria-12B.i1-Q4_1.gguf new file mode 100644 index 0000000..89410a7 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:846a563d7cc8a55f4c86d408644304c96dec0fa6770d3a7f5fd7e42add20780d +size 7559564992 diff --git a/DarkIdol-Aria-12B.i1-Q4_K_M.gguf b/DarkIdol-Aria-12B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..6b9a6ce --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b18a92d867c05447ff10e23fc4139558dcc33255b6f116c730dad1989af8d646 +size 7300779712 diff --git a/DarkIdol-Aria-12B.i1-Q4_K_S.gguf b/DarkIdol-Aria-12B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..24cc15f --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f741eaf89e5c713761e9b0187ce3259e7d06da556168b8cd22189310927c20b +size 6935334592 diff --git a/DarkIdol-Aria-12B.i1-Q5_K_M.gguf b/DarkIdol-Aria-12B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..afe22ce --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2310594ae4dc54f59c67fff91abd353736c05b97fd163a835349ffea2af1e0c2 +size 8445038272 diff --git a/DarkIdol-Aria-12B.i1-Q5_K_S.gguf b/DarkIdol-Aria-12B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..584d06c --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f992492214f43015019464c8c0f5b00e14afd6832e0040004e3a0b807509fbb5 +size 8231964352 diff --git a/DarkIdol-Aria-12B.i1-Q6_K.gguf b/DarkIdol-Aria-12B.i1-Q6_K.gguf new file mode 100644 index 0000000..49c3fd0 --- /dev/null +++ b/DarkIdol-Aria-12B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:323839c47206a84f67a2a575ce174f7b591a43f26f368439a289589e0c543b02 +size 9660812992 diff --git a/DarkIdol-Aria-12B.imatrix.gguf b/DarkIdol-Aria-12B.imatrix.gguf new file mode 100644 index 0000000..c0dbe63 --- /dev/null +++ b/DarkIdol-Aria-12B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b09710e466d4157a1c720a41f9347fa4c1f5ea5302018e03c5a6d503e013e23 +size 7473632 diff --git a/README.md b/README.md new file mode 100644 index 0000000..040ed94 --- /dev/null +++ b/README.md @@ -0,0 +1,93 @@ +--- +base_model: aifeifei798/DarkIdol-Aria-12B +language: +- en +library_name: transformers +license: gemma +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- roleplay +- sillytavern +- idol +- youtube +- google +- pytorch +- DarkIdol +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/aifeifei798/DarkIdol-Aria-12B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#DarkIdol-Aria-12B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/DarkIdol-Aria-12B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-12B-i1-GGUF/resolve/main/DarkIdol-Aria-12B.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +