mradermacher/Cydonia-24B-v4.3-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Cydonia-24B-v4.3-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-10 11:21:56 +08:00
commit 382d35bf84
26 changed files with 214 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v4.3.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

3
Cydonia-24B-v4.3.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06428f856a89cb92074c23419f56e33a73ee3b776a01771ef8c843d49cf826b1
size 5750497088

3
Cydonia-24B-v4.3.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1353f16c69d9f1a5693e0f4238ba1f9705e6633999deab6e10e4ee8bd046debe
size 5273722688

3
Cydonia-24B-v4.3.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:768447c1949ad1b16900b49d13da42a49180484007c255d06a6e8eb7e87915f4
size 8114052928

3
Cydonia-24B-v4.3.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a197782c13e70451d4346de1dbc48e6095ce47f3dce4ffe81ae1982854ae0953
size 7478353728

3
Cydonia-24B-v4.3.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8070c46e811d12a5b44fe59853d514bb3d2dd50e7295ce1199c589f0d385b2a
size 7207034688

3
Cydonia-24B-v4.3.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47751643d0d1ffe4e0842aee21cc1472ce548046f88380dfacc3e83075aa0c8e
size 6545121088

3
Cydonia-24B-v4.3.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:422a424b7b273e7f4e820ad8fb8e9b7670c8d04a7b6bf00d0794ddebe8a69d7d
size 10650951488

3
Cydonia-24B-v4.3.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:905d7173798a1a8c817cb739fc88aa6ea65865484084ac651b10d7e14f5c1ef9
size 10428129088

3
Cydonia-24B-v4.3.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70a66f99b41d5e3bad6e621b5d3b273f441189356fae2a92425e761a84723719
size 9907117888

3
Cydonia-24B-v4.3.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a062c80015b3ff1cec5e5f11ff13d425dc4a1de248654209aef08eb756a02db
size 9280593728

3
Cydonia-24B-v4.3.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69e36c1f0a2cc672808fdf0751dae347d4264c68d6e513bb6baac4fd5ad351d7
size 12758916928

3
Cydonia-24B-v4.3.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d223b1dc3a532849639c2e5a8f32c28f72033e07f82a099a2753d6fa04b7cc6
size 8890326848

3
Cydonia-24B-v4.3.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:515b43cceed44d8a6b4a5983c26eb87932713c69a325df7c205666e20bc1ab40
size 8320163648

3
Cydonia-24B-v4.3.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50e2d53ff31fbc6c12fde800db8f38c936b6a86abb249df596bf6b147bd62e5f
size 12400762688

3
Cydonia-24B-v4.3.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3316ad2cdb9064198cdd94731115f1b1f8a3893401419c84a3e78112657a057e
size 11474083648

3
Cydonia-24B-v4.3.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf051cc6b52ef56e8c6292bc24af66337362277ac6d518259c9e27107fa8ab14
size 10400276288

3
Cydonia-24B-v4.3.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67287e3367e9a5e43f8356307beb8c63ae43584181a883ce1b53c16c9215e601
size 13494230848

3
Cydonia-24B-v4.3.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71cdcd6a50701846612a1a16f05c723ccea5ceaad64a2abfa67e0f6385fe599e
size 14873108288

3
Cydonia-24B-v4.3.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9e4aab579ff705c5f1eee9765efb146afa8d79b63eb44d42176d7d23a23da30
size 14333910848

3
Cydonia-24B-v4.3.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3597663869bf18259a14aeec58075223c289ce07d1fad0d3ff58984ece32f4c
size 13549281088

3
Cydonia-24B-v4.3.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b7722e19d85504d5a31badd0e51cff1c8ec9ffce4bd9c62cfbe87b6b21287c6
size 16763985728

3
Cydonia-24B-v4.3.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34ce9b23322a9621d5d6ccf9a7f0d037c29891dbec151f4471d2720b5deef4fe
size 16304414528

3
Cydonia-24B-v4.3.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98ffc6d8458096612008310e74c4cab8118b20feb95103ec06af47dd142005a4
size 19345940288

3
Cydonia-24B-v4.3.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7402bb4bc74e98ff3e84aeb4a364e35782ee1e279d7c734db356e9d45fca933
size 10037312

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: TheDrummer/Cydonia-24B-v4.3
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/TheDrummer/Cydonia-24B-v4.3
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Cydonia-24B-v4.3-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Cydonia-24B-v4.3-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v4.3-i1-GGUF/resolve/main/Cydonia-24B-v4.3.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->