mradermacher/Chaifighter-20B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Chaifighter-20B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-16 19:30:17 +08:00
commit 10d515dd0d
25 changed files with 204 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Chaifighter-20B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Chaifighter-20B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08fbf4092ebdb8ea488390bc9785b9a27686d67ada312383609060b21a1b709f
size 4889525920

3
Chaifighter-20B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c92df209c2aba9fc3e3186b69dda5ff8b27192d546f46fe23aa60fa74ae55cf1
size 4470357664

3
Chaifighter-20B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd7d71fa00a35072d38ef009a799beee7737820f35988bf92231d4967d9e2641
size 7055892128

3
Chaifighter-20B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6a38b6a13ae9459b8e4a7a2444e21110053a64939b6ff01b5cdffec95506fd4
size 6497001120

3
Chaifighter-20B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d11235a6e73831094e73576c1ad982e99ae9d8ef1457415f84d5d5dc31671fc5
size 6196313760

3
Chaifighter-20B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3d6b77304c189bfad7db64006e166bdd2368932b686342f286edc1f18faf9b2
size 5588139680

3
Chaifighter-20B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3749258e66cc1b644fb9d1a8fb1005665d1f92a3ab145683f9e978b046f1743b
size 9324658336

3
Chaifighter-20B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e99cb3acc8ad4cf011fefbc009ed2a7421193161f8a0a508fbe2cbf24adf6723
size 9029418656

3
Chaifighter-20B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbf2b67f695a95eef3ed26ebe6e49485a10b4dc01478869f318d44535ea73821
size 8546156192

3
Chaifighter-20B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:122e54c296157bd1dfa1291f88d6c7cca0b43abdce8e51996acddc5995f54b79
size 8020188832

3
Chaifighter-20B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88979196fd56e5393466361d25ab22d25f11ce7136dae54d1e80b0cabcbd0a77
size 11134181024

3
Chaifighter-20B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd81544df0b708dbf90dfcf7c31d65e1e8bdb88edfba74e5b63e417a6f3dee16
size 7694704288

3
Chaifighter-20B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8f6cfdc74e0c612a9719e2ea391f19f4f97e1cec960c2b1ee0c1ee224b694cd
size 7125327520

3
Chaifighter-20B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09469bab8c0ab96a01215b7b4599bf62c4c2b22c4d1a1ba3bf49eaf7bf13bbef
size 10908335776

3
Chaifighter-20B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a79f3f42f35ff7ada42f2546a8339a8562a796a20b0914268ac2107fd88ad278
size 10009706144

3
Chaifighter-20B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9993da4b47b0a8eb032ef0811a653c03c1c0f6fc940e01a0d6c8033eb2e07f3f
size 8977055392

3
Chaifighter-20B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03fd68d0246b530ee464bbd628305af8533ae1cc10cff36204124a84024db465
size 11757723296

3
Chaifighter-20B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cc320527850640cf62e268397a87db3ab6fb827ec5402ab0ceae1062c13daf4
size 12463480480

3
Chaifighter-20B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b5318830859109f0d0407bbba419682892514b101070f74370427e49f9165ae
size 11800190624

3
Chaifighter-20B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62af66a3476903f83ea7e77a455bf5ff1aaf296573a5fce46a833904e448341f
size 14680825504

3
Chaifighter-20B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af444bf64ee12685914b0ae0bebdec2d7350448f2d478440ef5e987b8efed409
size 14296456864

3
Chaifighter-20B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74e8bfd3576921f5a3c8753f76522c73d1d3bf359c37e7a6b6466040cef29eb8
size 17036754592

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: matchaaaaa/Chaifighter-20B
language:
- en
library_name: transformers
license: cc-by-4.0
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/matchaaaaa/Chaifighter-20B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Chaifighter-20B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ1_S.gguf) | i1-IQ1_S | 4.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ1_M.gguf) | i1-IQ1_M | 5.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 6.3 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ2_S.gguf) | i1-IQ2_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ2_M.gguf) | i1-IQ2_M | 7.2 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 7.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q2_K.gguf) | i1-Q2_K | 7.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 8.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 9.1 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ3_S.gguf) | i1-IQ3_S | 9.1 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ3_M.gguf) | i1-IQ3_M | 9.4 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 10.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 11.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 11.2 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q4_0.gguf) | i1-Q4_0 | 11.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 11.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 12.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 14.4 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 14.8 | |
| [GGUF](https://huggingface.co/mradermacher/Chaifighter-20B-i1-GGUF/resolve/main/Chaifighter-20B.i1-Q6_K.gguf) | i1-Q6_K | 17.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4ead566b11956da0108db1654c4aa48c07ae5fbcc7591a63f70bc45ce56caed
size 14652779