commit fc654631eb0ab9230b7bb5dbfb527aa249bb2164 Author: ModelHub XC Date: Wed May 20 02:52:45 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..dd384d3 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf new file mode 100644 index 0000000..5b473db --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8da08662a7d350671e5feb3fb1a0000a45e15d3f2135bff52bff9d02c602ef25 +size 3221628576 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf new file mode 100644 index 0000000..4676928 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56bccf27735a08528afa777b957af221c27cd3bc7f54a780a013f99e4426b779 +size 2999215776 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf new file mode 100644 index 0000000..ada8d80 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:931906cc41eef876e27302f70e870aeb56d5c631d63467e163a9f163c5716c51 +size 4435027616 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf new file mode 100644 index 0000000..391eb40 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5f110af10c0ee686c400b5f47317f796926bf15f5b05bf2478f9f95bbedcfa36 +size 4138477216 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..a8446e8 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:453381f10190b03ffe6e60bd3c02e08fb15b9439767e3b3946cd95af42d1c3f9 +size 3915081376 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..632040c --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df56da0dc8ba5afb7cfdf324457a3e1c7696fe1b1446f57d63a56997c6aba3d4 +size 3592316576 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf new file mode 100644 index 0000000..4d0894c --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd28893a87aa07d81fe4f4e6a0485d394fd5607b1ccae86d521ce381c404188a +size 5722236576 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf new file mode 100644 index 0000000..16471b7 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eea024b977e710d5de9de77d2ddfbdf8349c23c3e3925364237f26e87fd16b96 +size 5562082976 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..224cfd8 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95353462bdf1ac928e8c6304da7b3df3419bd328cf3e3a78e2ea2d8dd4807bad +size 5306492576 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..56583b2 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6bac5a0d2d000c6324d8ff15f055a3fa3ccc3109b698141f8a6e1da7a2109a92 +size 4945389216 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..5bda5e5 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7413a73f5e8dbebcaa81e0d5db508c9022f7d24428b5a8bfc78c51a75566b759 +size 7097919136 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..71f9a1f --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e77e45a613dd812ccd5871159b94d0994339767b19a66c3ad790c3ae89b53f5 +size 6742714016 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf new file mode 100644 index 0000000..c81061a --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f6cb04e250f2b3312eaa13b51440d3a9ab934c2f588dbc2a902cc3e69855bcc +size 4791051936 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..ab5b39d --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd4aa84f8501a74d023d8cefb820e4b764b5722a28876821649d6c1387a46ce0 +size 4493682336 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..0272002 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:39ec11fd1612fc6fdc78089cd053237c1825838dcc6c3a29f78d7365ae17e7a1 +size 6561506976 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..c57b0ae --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e9c3a0febdc4c839de4d74c6d71ea2ccf1ede672636a5d5d4c3e39767a57bce1 +size 6083094176 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..7a95545 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c582e8d4ec8a2db18e642838d715a9c98ddce8fc20ccbea59bdc5dd281f12f1 +size 5534230176 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf new file mode 100644 index 0000000..93874f3 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90697d71a5fa35e5a2a95e3b795b08d4e70c1578e0570f286e7b650bb854068d +size 7094642336 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf new file mode 100644 index 0000000..4b77430 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca412808dce7923edca8d144b614af33f21054eb124873047dbbffad9b1d8e6f +size 7795222176 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..55e99c8 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:41300ceb2fd9805d9bd3fc0b088e9b3698a93e0f7500b73ad32ac6ceb8acce62 +size 7477208736 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..c11b1ef --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca4d62e71b7f2e5726c1ca2143017b91c39fb639f04a4caba2ab9843d207a90a +size 7120201376 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..011fa33 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04bfc913cf308112837a1c32810d14fca0128734b9e5fabafa01084b8ef9979a +size 8727635616 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..e708d3f --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89a64ddf57584de1348b27953401ef8977628ad24ccc4d81cf7877a2bc698e54 +size 8518739616 diff --git a/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf new file mode 100644 index 0000000..8af0311 --- /dev/null +++ b/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51f9d9a663b2c58fbe1f6452cf5bfd728a1170a4af9bc3d3863d4e3c5c724040 +size 10056214176 diff --git a/README.md b/README.md new file mode 100644 index 0000000..665d0f9 --- /dev/null +++ b/README.md @@ -0,0 +1,78 @@ +--- +base_model: ftamas/Capt-Eris-Diogenes-v0.420-Dark-Science-12B +language: +- en +library_name: transformers +quantized_by: mradermacher +tags: +- mergekit +- merge +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/ftamas/Capt-Eris-Diogenes-v0.420-Dark-Science-12B + + +static quants are available at https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | | +| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..751c1fc --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a60f2e88f7e893f6d50e8b5f53d704691336ae8b619036008274cb4c8810eb60 +size 7054405