mradermacher/Cydonia-24B-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Cydonia-24B-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-20 01:12:36 +08:00
commit a353bd6f1a
26 changed files with 206 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Cydonia-24B-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Cydonia-24B-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3428071534b7da42b990165d5cd3eceae3379d51575ffbd35793880472733d3
size 5750494400

3
Cydonia-24B-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3843d1fe7fa22a5c9584a9c6177d33a9b50a41415553cba344fd231cbda0192d
size 5273720000

3
Cydonia-24B-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f5d7cc0a1fbd887fac50ed20668f4ccc457847b55472da3c4b3c052618c2721
size 8114050240

3
Cydonia-24B-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdac460d6e2913c75522d3170f4715d98e8841404a780e833b9f1cd7244806c8
size 7478351040

3
Cydonia-24B-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c52fe7a7f8135ab88ebe82116282ee58d61d1f1382d206489737794911a73e67
size 7207032000

3
Cydonia-24B-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c794f8292696bf637c003f851fe781f1da713164f81efa84d81e12bd781f849
size 6545118400

3
Cydonia-24B-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98be96270d73b19368897d389dd93bd0866414a558b7f965219e32fcb47ebdc1
size 10650948800

3
Cydonia-24B-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13c818922cecd6842486ab5498c9caaa69a05c2d0f4cbcdce0f1bc551372cedb
size 10428126400

3
Cydonia-24B-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:632dafd7edc9f4778229f38fa6817161b66affe83104378ab94260d9f09d7621
size 9907115200

3
Cydonia-24B-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6266ef1c8d1409863ddba0b5c2fdec2097b6a5b029996c3f9948aaa33ca39d7
size 9280591040

3
Cydonia-24B-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef040ff8af02560486e8d8d3a29f714563c1982a49b6242de053f7fd280b31c8
size 12758914240

3
Cydonia-24B-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83e4459e26be1658ac95500e9c01e53536f82daf071cc4e3672d065b83c9a0dd
size 8890324160

3
Cydonia-24B-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:778ffc9b09b57821a2958d5e3f965496f0c49012c0e29a16e90bd5a4faea5a3e
size 8320160960

3
Cydonia-24B-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c047874bbf4e9740f9897f8aaf8f0363d6009c4b4b0de6d93379ade481b5b6f7
size 12400760000

3
Cydonia-24B-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee06e2f8e018fe87084ce9ce40bfb525e253c6b4df9f439a23447a6eeac241b8
size 11474080960

3
Cydonia-24B-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d229d027d0f583ca900ad53f3c2041320bd6a3a663cb7c9fdeceef7e70481e6a
size 10400273600

3
Cydonia-24B-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:162850527f417df5142d1d8aa6c22b006f0bf1420934079759f27b6742f041b3
size 13494228160

3
Cydonia-24B-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc99d0b16beff3e11cc820da89aac274ca6f08823cf71232c874d5cccf67d862
size 14873105600

3
Cydonia-24B-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:721ba8c6fd353281e97a0fd4ae19ed8407ab395aa561c79b88f6f85542345a07
size 14333908160

3
Cydonia-24B-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1768a70126c604803ebfee747ef8b859a754312e927023c5ddbf629ce736997d
size 13549278400

3
Cydonia-24B-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0dfe8cb72aab97a0212e7ab9d7174eb5b7cc62b33792e1e5b651ed376908369
size 16763983040

3
Cydonia-24B-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4845e400a874b20700fa3bf7c4be1a7decafd63ccb3a7e7745d9eccfff745253
size 16304411840

3
Cydonia-24B-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d6af92f50a65a5a73a78af5a9c6ab69c67544488d1674ec36bc0985e934a8b8
size 19345937600

75
README.md Normal file
View File

@@ -0,0 +1,75 @@
---
base_model: TheDrummer/Cydonia-24B-v2
language:
- en
library_name: transformers
license: other
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/TheDrummer/Cydonia-24B-v2
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Cydonia-24B-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/Cydonia-24B-v2-i1-GGUF/resolve/main/Cydonia-24B-v2.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69cca2d29de97daf631cb465094eff2fad9a53f18aaa2582e515e46d286d2e36
size 10003525