commit d8ea857c2ae75971311ffb2c38166ffcc30d47dc Author: ModelHub XC Date: Sat Jul 4 17:42:15 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..72975c2 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,57 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_M.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_M.gguf new file mode 100644 index 0000000..09d59af --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3d28a3b00cfe3a34cc9e29820f8f2551cd0c8e0d6ac4e428b1f18047ea4d3408 +size 2161973376 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_S.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_S.gguf new file mode 100644 index 0000000..234f31d --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8c8c85d21a46d92b6a909e3ee9725ad52afa35001451b8206616e3fb6cc3109a +size 2019629184 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_M.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_M.gguf new file mode 100644 index 0000000..f65989d --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:39e65e3eb5302738136bd933685a773d5b2c0a80f90a6841e08d01e909b4fb0e +size 2948282496 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_S.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_S.gguf new file mode 100644 index 0000000..caf4567 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6262911092cf15d9c750147175f8fe74078948073cb802d8d9a200d7b4e7e395 +size 2758490240 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XS.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XS.gguf new file mode 100644 index 0000000..98ba832 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:273a3048a8ad6c8be4aef49d1816f57ec573c0a5d736117c8e83c4603372f58f +size 2605783168 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XXS.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..ca1bf6f --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1cb49f9a6853b9d7ce5baf118c6b6966ea5e6c5fff91aad5f0e59f04efeb954 +size 2399213696 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_M.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_M.gguf new file mode 100644 index 0000000..d8d4ffe --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:907b5e6611a839fcd6adad6378657faa1c321107b9d4ee1028e66a50517d3d6f +size 3784824960 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_S.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_S.gguf new file mode 100644 index 0000000..c429756 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc7005a8be852a86cede1ce9d0214be787c2f6b4324d1be8106d5828463a2a96 +size 3682326656 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XS.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XS.gguf new file mode 100644 index 0000000..1660ea9 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8930074ec3219cf31aba0fe500f43d8f8b09136dabedeb0a0a898e6626407dd4 +size 3518748800 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XXS.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..c8fba59 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ac36466a9ae89d9a1954562fd07b55b8fb24b841c8bac28fc7b17d213ac502c +size 3274913920 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ4_XS.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ4_XS.gguf new file mode 100644 index 0000000..1d62901 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d289b2cc83be05269869b2a84c99d02baaf3deb3433f6cde57381b06a425674 +size 4447664256 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q2_K.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q2_K.gguf new file mode 100644 index 0000000..3bc2209 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:76b2c90922daa92b413b965789f3ee6dff4a9f841750f61b4116d29089083124 +size 3179133056 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_L.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_L.gguf new file mode 100644 index 0000000..1fcfb30 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2335471ee7c64ff0d4c066606164f3af44a5af979daa2415b2aace65beb5533d +size 4321958016 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_M.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_M.gguf new file mode 100644 index 0000000..c385281 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:18429b1cbfa956a2b5f0b3e9d319c0a264cb6bc8ef936bc8070ab96108f95f75 +size 4018919552 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_S.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_S.gguf new file mode 100644 index 0000000..f03e174 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:078e66016be21b717f703f555ceb3fad633e7cb6b30fc2fe00afaa3e1b3fd241 +size 3664500864 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_0.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_0.gguf new file mode 100644 index 0000000..25a7c67 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:97cc225b2455af75dce32a1ab00a6f5c0e8a00cb4a812f80e24046c352fd0e71 +size 4675893376 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_M.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_M.gguf new file mode 100644 index 0000000..0a3486e --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ffaf6ae82ee73277fee646988c1100bc9d3bd8d91fbcd43f3e1b78c95e0cd40 +size 4920735872 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_S.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_S.gguf new file mode 100644 index 0000000..7056ce8 --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e55bd5b32d38859d128327e03095e9b1396e753942bb8bd2365b01105c305a49 +size 4692670592 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_M.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_M.gguf new file mode 100644 index 0000000..cc9d19e --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e2d4aee45e4cd5f9ab3290225a5ed0cb0987db96cb61557bf2cf3899efaad1c9 +size 5732989056 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_S.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_S.gguf new file mode 100644 index 0000000..47dbddb --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:26a37bac428c85bc5dc08a416b36b747f26f5ac7ea62299f74b423ced2ee85af +size 5599295616 diff --git a/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q6_K.gguf b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q6_K.gguf new file mode 100644 index 0000000..8728abf --- /dev/null +++ b/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:476fb2e5e21c56d5bb8ff2c5c2c767578bce1c8a865bc87bbd206ed364dd6064 +size 6596008064 diff --git a/README.md b/README.md new file mode 100644 index 0000000..14093a7 --- /dev/null +++ b/README.md @@ -0,0 +1,108 @@ +--- +base_model: aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored +extra_gated_fields: + Affiliation: text + Country: country + Date of birth: date_picker + First Name: text + Job title: + options: + - Student + - Research Graduate + - AI researcher + - AI developer/engineer + - Reporter + - Other + type: select + Last Name: text +language: +- en +- de +- fr +- it +- pt +- hi +- es +- th +- zh +- ko +- ja +library_name: transformers +license: llama3.1 +quantized_by: mradermacher +tags: +- roleplay +- llama3 +- sillytavern +- idol +- facebook +- meta +- pytorch +- llama +- llama-3 +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored + + +static quants are available at https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF/resolve/main/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..2465236 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff1424c4c11fa11ec18637d8d12ba94d5cd8189d58901fe7f6f4f850aa10dc56 +size 4988157