mradermacher/Mocha-Coder-32B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Mocha-Coder-32B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-19 18:04:17 +08:00
commit b12b531b25
26 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Mocha-Coder-32B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Mocha-Coder-32B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2999d131126c18d27426b0c6066cec8cc6fdede30d4303643eca12544a4df78f
size 7932161344

3
Mocha-Coder-32B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4987e947a69e8fe8a5dc5f9086103bb15a5fa7801c544780a3265b9380d3db4d
size 7274507584

3
Mocha-Coder-32B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc969bdec0311fbd3dc132170a5e77e0907fc3ac0481edfbbeaa601119b905d7
size 11264441664

3
Mocha-Coder-32B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17820c2109d5bd669bfdd67e373f9b5ea6edf0098a8e5683d9fbe72f307470b2
size 10387569984

3
Mocha-Coder-32B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6a26e3dcc4223106bfc6670ccc8a4753c1d2db66632ee404ac8d504bd4b85da
size 9957551424

3
Mocha-Coder-32B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfbc930a4c8653ddb7c88c9a5a9ec1a0ce4bdd44e71a5f39d21b9a91cdbc70ce
size 9028250944

3
Mocha-Coder-32B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd6993352235fff5db585df3d67f707334b1255ba92a6550223f5528c01f14d8
size 14810123584

3
Mocha-Coder-32B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a832e57d0ebb76b7e589a61ed1ec113e4053e16312fdae3a7ecb583db8f3304
size 14436896064

3
Mocha-Coder-32B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d1b0ca9b6727ce8607fa2eb0580641ef960b39f4f7d505bb0205b675f616546
size 13705514304

3
Mocha-Coder-32B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:378eff3b0d4345852ccb39b3cb02de9e8073fe3c3b64cbc0cfbb03beda6fbed1
size 12839271744

3
Mocha-Coder-32B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:249e04d0fc39111918dbc6f24abe0b6731986cf35949393d7dd5255f24417317
size 17693154624

3
Mocha-Coder-32B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42a3af1b99171697876241a21af6e9792f1e9f69c8a9935ef2e5feaeb3f97833
size 12313099584

3
Mocha-Coder-32B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95792752c6dabd6fe105d7ef41cdf4512bfa0f7308661a307d7ac9382f96074a
size 11488001344

3
Mocha-Coder-32B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc2c60ba00d26ee1054a3301dc4cba6d8a9eeab19ec5688d70da8c81e7dc8523
size 17247079744

3
Mocha-Coder-32B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1af6abdb05b8d09aa6e37619586c628bf8cc1c9299bcd4f9d3b1a407889e001
size 15935049024

3
Mocha-Coder-32B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f452e7c2b56d4f4b04257db1e1cd70a650ef985a0ff6b65566390f18f563509
size 14392331584

3
Mocha-Coder-32B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48cb3cf9f88823875a7a118296c933fba54c9728a2eb1fcaabd3b353c3a16c39
size 18711010624

3
Mocha-Coder-32B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8af114e57e6d4b7100d70f28ac9a37129a8f92556afe6911a487b0c63a4315e
size 20639243584

3
Mocha-Coder-32B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22324a493ea1b22edf772bfb7c69e7e0b1c6ae9949252057d784acd3941ad029
size 19851337024

3
Mocha-Coder-32B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f476b71b2d1b1c543403c9f0452b7501e8ae2625d664b7f4b1357bd61e0276b0
size 18784410944

3
Mocha-Coder-32B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16cd876e195ac123046f7fc3a273ca1972427c8564ac8f576e4804cedd5a7481
size 23262158144

3
Mocha-Coder-32B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37cde5c294939bb6cef3c97fb7b79dc081724270a2f89e3dd0242169e6a4399e
size 22638255424

3
Mocha-Coder-32B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e72a2d2ea7e22e7124df338a0aff329321f277900e7543ea9615b4d8ca1b4a10
size 26886155584

3
Mocha-Coder-32B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b0292775efd23ce5789f45992d53f0b3901cc4ca8f43eaaccd41d06091c17f1
size 15011072

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: cocoa-org/Mocha-Coder-32B
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- code
- coding-agent
- SWE-agent
- distillation
- agent
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/cocoa-org/Mocha-Coder-32B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mocha-Coder-32B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Mocha-Coder-32B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ1_M.gguf) | i1-IQ1_M | 8.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ2_S.gguf) | i1-IQ2_S | 10.5 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ2_M.gguf) | i1-IQ2_M | 11.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ3_M.gguf) | i1-IQ3_M | 14.9 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 20.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mocha-Coder-32B-i1-GGUF/resolve/main/Mocha-Coder-32B.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->