初始化项目，由ModelHub XC社区提供模型
Model: mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8da08662a7d350671e5feb3fb1a0000a45e15d3f2135bff52bff9d02c602ef25
|
||||
size 3221628576
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:56bccf27735a08528afa777b957af221c27cd3bc7f54a780a013f99e4426b779
|
||||
size 2999215776
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:931906cc41eef876e27302f70e870aeb56d5c631d63467e163a9f163c5716c51
|
||||
size 4435027616
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5f110af10c0ee686c400b5f47317f796926bf15f5b05bf2478f9f95bbedcfa36
|
||||
size 4138477216
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:453381f10190b03ffe6e60bd3c02e08fb15b9439767e3b3946cd95af42d1c3f9
|
||||
size 3915081376
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:df56da0dc8ba5afb7cfdf324457a3e1c7696fe1b1446f57d63a56997c6aba3d4
|
||||
size 3592316576
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fd28893a87aa07d81fe4f4e6a0485d394fd5607b1ccae86d521ce381c404188a
|
||||
size 5722236576
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eea024b977e710d5de9de77d2ddfbdf8349c23c3e3925364237f26e87fd16b96
|
||||
size 5562082976
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:95353462bdf1ac928e8c6304da7b3df3419bd328cf3e3a78e2ea2d8dd4807bad
|
||||
size 5306492576
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6bac5a0d2d000c6324d8ff15f055a3fa3ccc3109b698141f8a6e1da7a2109a92
|
||||
size 4945389216
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7413a73f5e8dbebcaa81e0d5db508c9022f7d24428b5a8bfc78c51a75566b759
|
||||
size 7097919136
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8e77e45a613dd812ccd5871159b94d0994339767b19a66c3ad790c3ae89b53f5
|
||||
size 6742714016
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3f6cb04e250f2b3312eaa13b51440d3a9ab934c2f588dbc2a902cc3e69855bcc
|
||||
size 4791051936
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dd4aa84f8501a74d023d8cefb820e4b764b5722a28876821649d6c1387a46ce0
|
||||
size 4493682336
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:39ec11fd1612fc6fdc78089cd053237c1825838dcc6c3a29f78d7365ae17e7a1
|
||||
size 6561506976
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e9c3a0febdc4c839de4d74c6d71ea2ccf1ede672636a5d5d4c3e39767a57bce1
|
||||
size 6083094176
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6c582e8d4ec8a2db18e642838d715a9c98ddce8fc20ccbea59bdc5dd281f12f1
|
||||
size 5534230176
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:90697d71a5fa35e5a2a95e3b795b08d4e70c1578e0570f286e7b650bb854068d
|
||||
size 7094642336
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ca412808dce7923edca8d144b614af33f21054eb124873047dbbffad9b1d8e6f
|
||||
size 7795222176
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:41300ceb2fd9805d9bd3fc0b088e9b3698a93e0f7500b73ad32ac6ceb8acce62
|
||||
size 7477208736
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ca4d62e71b7f2e5726c1ca2143017b91c39fb639f04a4caba2ab9843d207a90a
|
||||
size 7120201376
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:04bfc913cf308112837a1c32810d14fca0128734b9e5fabafa01084b8ef9979a
|
||||
size 8727635616
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:89a64ddf57584de1348b27953401ef8977628ad24ccc4d81cf7877a2bc698e54
|
||||
size 8518739616
|
||||
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf
Normal file
3
Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:51f9d9a663b2c58fbe1f6452cf5bfd728a1170a4af9bc3d3863d4e3c5c724040
|
||||
size 10056214176
|
||||
78
README.md
Normal file
78
README.md
Normal file
@@ -0,0 +1,78 @@
|
||||
---
|
||||
base_model: ftamas/Capt-Eris-Diogenes-v0.420-Dark-Science-12B
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/ftamas/Capt-Eris-Diogenes-v0.420-Dark-Science-12B
|
||||
|
||||
<!-- provided-files -->
|
||||
static quants are available at https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Capt-Eris-Diogenes-v0.420-Dark-Science-12B-i1-GGUF/resolve/main/Capt-Eris-Diogenes-v0.420-Dark-Science-12B.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||
|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a60f2e88f7e893f6d50e8b5f53d704691336ae8b619036008274cb4c8810eb60
|
||||
size 7054405
|
||||
Reference in New Issue
Block a user