mradermacher/Cydonia-24B-v4.3-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:da191fcfbf664bb14263abdde86fae07291980ce
Branches Tags
mradermacher:main
..
compare: mradermacher:f34c8133902ab6f5d72a01a14a471628929a22f4
Branches Tags
mradermacher:main

10 Commits
da191fcfbf ... f34c813390

Author SHA1 Message Date
team mradermacher
f34c813390 auto-patch README.md 2025-12-07 18:14:48 +00:00
team mradermacher
9ce5f62c95 uploaded from rich1 2025-12-07 18:12:41 +00:00
team mradermacher
670733eb10 uploaded from rich1 2025-12-07 18:04:11 +00:00
team mradermacher
ebf932c62e uploaded from rich1 2025-12-07 18:03:59 +00:00
team mradermacher
68e5e5290c uploaded from rich1 2025-12-07 18:01:39 +00:00
team mradermacher
1ec80d821e uploaded from rich1 2025-12-07 18:00:34 +00:00
team mradermacher
5f1f1c4e95 uploaded from rich1 2025-12-07 17:59:07 +00:00
team mradermacher
daa468a8e0 auto-patch README.md 2025-12-07 17:47:15 +00:00
team mradermacher
74d1cac8b9 uploaded from rich1 2025-12-07 17:44:43 +00:00
team mradermacher
fa9ca4545e uploaded from rich1 2025-12-07 17:43:47 +00:00
10 changed files with 52 additions and 0 deletions
Expand all files Collapse all files

8
.gitattributes vendored
View File

@@ -49,3 +49,11 @@ Cydonia-24B-v4.3.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

3
Cydonia-24B-v4.3.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1353f16c69d9f1a5693e0f4238ba1f9705e6633999deab6e10e4ee8bd046debe
size 5273722688

3
Cydonia-24B-v4.3.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a197782c13e70451d4346de1dbc48e6095ce47f3dce4ffe81ae1982854ae0953
size 7478353728

3
Cydonia-24B-v4.3.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:905d7173798a1a8c817cb739fc88aa6ea65865484084ac651b10d7e14f5c1ef9
size 10428129088

3
Cydonia-24B-v4.3.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70a66f99b41d5e3bad6e621b5d3b273f441189356fae2a92425e761a84723719
size 9907117888

3
Cydonia-24B-v4.3.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67287e3367e9a5e43f8356307beb8c63ae43584181a883ce1b53c16c9215e601
size 13494230848

3
Cydonia-24B-v4.3.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71cdcd6a50701846612a1a16f05c723ccea5ceaad64a2abfa67e0f6385fe599e
size 14873108288

3
Cydonia-24B-v4.3.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b7722e19d85504d5a31badd0e51cff1c8ec9ffce4bd9c62cfbe87b6b21287c6
size 16763985728

3
Cydonia-24B-v4.3.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34ce9b23322a9621d5d6ccf9a7f0d037c29891dbec151f4471d2720b5deef4fe
size 16304414528

20
README.md
View File

@@ -37,9 +37,29 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):