mradermacher/Winton-Codex-24B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Winton-Codex-24B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 19:54:09 +08:00
commit d1d1403d93
26 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Winton-Codex-24B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: Ateron/Winton-Codex-24B
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- roleplay
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Ateron/Winton-Codex-24B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Winton-Codex-24B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Winton-Codex-24B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/Winton-Codex-24B-i1-GGUF/resolve/main/Winton-Codex-24B.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Winton-Codex-24B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df2271ec321b144ca7808f8185c3575b20113d6080fccd16609eaf8a679e2812
size 5750495072

3
Winton-Codex-24B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06c0c0cf648c1dc6becdbb478f7f342e296fdd46b2dbd981548f04283cf42d1f
size 5273720672

3
Winton-Codex-24B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8073329dcc2f8c9a46efa6c7b27306a80735f24a721f77974666a9058e92fb9b
size 8114050912

3
Winton-Codex-24B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a06b9bd67f337f7bb59ca78f5320ad9cb2cb530f0917a0b308e5e90eeae65367
size 7478351712

3
Winton-Codex-24B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf3f20e1f651f9e76f9b6e3df4673a8a6a115c3c34cc40c1fe52fcf90f022e20
size 7207032672

3
Winton-Codex-24B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19a60e189c6ac8f4748547dc9c030e35b174a7f8d5147f558487667a083005e4
size 6545119072

3
Winton-Codex-24B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0676fc12039c67bd2bbf24e5973dd86d8d2c219dbd566823ce2f44b76bc525d9
size 10650949472

3
Winton-Codex-24B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b0f30031673e723acd49990a140a3c8e561c04510716798f87541405f733866
size 10428127072

3
Winton-Codex-24B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48c70bc6a2e8b9f7d832cdfa6b1e70ef8e656270e2bb4c205da954a454914276
size 9907115872

3
Winton-Codex-24B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4dfeb2267318d06eab6b7dcb7fb55b020e9baa779e39ae6358a9ea91576a969
size 9280591712

3
Winton-Codex-24B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a68cd6959427b78cd96a7b8505087f81f8b511546dc218c800766a5780cfd7c6
size 12758914912

3
Winton-Codex-24B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bd83c5811e352d2129ca27534aad6720a0a490af5d68e964069d4b7fe135291
size 8890324832

3
Winton-Codex-24B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6455fcee0e311bdf728ddd14ead3acd9488cee01f33fd0dbcb6db339fc3d869a
size 8320161632

3
Winton-Codex-24B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb8104b6406554c06d286ea9a31720c419d5b6a6058f1a4e854b32b1467e307a
size 12400760672

3
Winton-Codex-24B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f973d7b41847a4197d37017996e5abda83ef28d9e2a6b9e87e1822e130b90168
size 11474081632

3
Winton-Codex-24B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04adbfb1fadbc7530e4875dbb09dbafe97c06f731b6205e9a809361dcb39c88b
size 10400274272

3
Winton-Codex-24B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:634948f4c993429770791e22e757859842a7db8af8b860547e36a2f17c1869bc
size 13494228832

3
Winton-Codex-24B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d306f4486dd74c4cfe0a86df12472e037fcad4b72d31fc6f9224c13677c821e0
size 14873106272

3
Winton-Codex-24B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53e5df994dc8f14a172dcadd35741a5bb99fa0a0ed1b7a8544dfefeec78dbc4e
size 14333908832

3
Winton-Codex-24B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b76cb34464e900f67b4a4da6707542c7121a484f8eb4c70f6cadf633e021b177
size 13549279072

3
Winton-Codex-24B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f265060c8659d16bd168d816a1712cae0eef2dd9b6749996f4c831a50eb6acae
size 16763983712

3
Winton-Codex-24B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a824c1866e93a7e22f542a33f52e7afd927aa4da3a7d8fb6eda86df1a7bf087b
size 16304412512

3
Winton-Codex-24B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6ff1e341ce53c86869883cd0d6875b2a2653266115e9912cad7229281d28ec8
size 19345938272

3
Winton-Codex-24B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e2f5c9721a931346c494ff1654c215858355b357a10ca3c1412a5e4644ac193
size 10037312