mradermacher/FirePaintedCydonia-24B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/FirePaintedCydonia-24B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-11 11:17:56 +08:00
commit ffe3f45b28
26 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
FirePaintedCydonia-24B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

3
FirePaintedCydonia-24B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b17dbef964095905fdd1931babe174d3a220fc57dfc83137723a0a53c2a12cce
size 5750495328

3
FirePaintedCydonia-24B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c3f46e3e2fff33b7a27f39d9dcc17ddf9cb804fb4a0c3460eaacb211e89cc17
size 5273720928

3
FirePaintedCydonia-24B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:281319235fcd28e3e28265c86f0754d6479cb430ebf0454c19bb6b4c92890fef
size 8114051168

3
FirePaintedCydonia-24B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75bb6bf61065741784340e8267868cbcccccd305d47f9ff26f852da043535a67
size 7478351968

3
FirePaintedCydonia-24B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6247df295a6911d3f9cfac6618fabdbae81043299a5cae238fbfc3dbb4d1f71
size 7207032928

3
FirePaintedCydonia-24B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50b63def46f26b3884310c7971cbc9db96cb6b29eab2eee075114e7faacbbb02
size 6545119328

3
FirePaintedCydonia-24B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25bef90d74a1aaa7c218f6a20a13a86872b9c15d7953dea084770e2d37a143f7
size 10650949728

3
FirePaintedCydonia-24B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fbf7aa7223769c157ea80b68bd286a51e2f0c4710283a31896f6c0e7944e0ce
size 10428127328

3
FirePaintedCydonia-24B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8be6ff02074cd3ed7ff014ab07ca01a6c6686ccf5ca66a3e29eafbc51640a22e
size 9907116128

3
FirePaintedCydonia-24B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e17308a18d4f99c7ad15320fd36dbd4d367571788d4b6991f2640ad76d48067a
size 9280591968

3
FirePaintedCydonia-24B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f456d60584efc2ff3ebceedaea7f8f169e942a2dd0c79e7da58308acb791810
size 12758915168

3
FirePaintedCydonia-24B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1118c597dfdcf89c0b12ea9baea8fae28480a209dcca9242fd3a2d5b2b0ddae7
size 8890325088

3
FirePaintedCydonia-24B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:096695cdb6602d5838bebd2fedde74b3fa976f155bd4c7a594013cc6db570343
size 8320161888

3
FirePaintedCydonia-24B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c428fde77c26d7efb07a31d3190fbed03a9a2cfcd05e0aa50f920c977feb01a5
size 12400760928

3
FirePaintedCydonia-24B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0bcb71a38b593895490621d502b994dd7a29008e5477d6fff4fdf782c5c31db
size 11474081888

3
FirePaintedCydonia-24B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c69977c27abaef6d33d6814be13bb53fd9dabf823d22a530881979e4af85895
size 10400274528

3
FirePaintedCydonia-24B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0c9c823ae072049ab37349c9a0643bed1f5205bd1d52b7cef730ac0d063daa2
size 13494229088

3
FirePaintedCydonia-24B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b64459bf69892b8966a3b91049e9d5a91dc9a22d5478e57e875af3cfeb675af0
size 14873106528

3
FirePaintedCydonia-24B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d11a791d8fd135d01f4c0d4c5cd223b3ff260e2ae2536da0c31a4fb0fb05f1fa
size 14333909088

3
FirePaintedCydonia-24B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c070d9c13094e7ddcc9a797d7d246b7efe6af5ed56da70c0f4183bf10e8d19d
size 13549279328

3
FirePaintedCydonia-24B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea2850f8043e6f0851fd9a7ab3eb54f4c95163452dc1bed34c442e139004dfbd
size 16763983968

3
FirePaintedCydonia-24B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3388ef6d43d8f9634e623ca8d9e2e1545e3b7d9fae8b93f4c1f511f0545e41e7
size 16304412768

3
FirePaintedCydonia-24B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78118958adce3124595385581be51bb3d79e92a6fd4a67659ac21b3127893454
size 19345938528

3
FirePaintedCydonia-24B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afcb6e4fbf7333aa0b71933e3d9ab32f24c65034cb566378243c4923bbd25621
size 10037312

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: Ateron/FirePaintedCydonia-24B
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- roleplay
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Ateron/FirePaintedCydonia-24B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#FirePaintedCydonia-24B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/FirePaintedCydonia-24B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/FirePaintedCydonia-24B-i1-GGUF/resolve/main/FirePaintedCydonia-24B.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->