mradermacher/Chocotest14B-1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Chocotest14B-1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-13 19:05:16 +08:00
commit dae7535d59
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Chocotest14B-1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Chocotest14B-1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb44b08dfeae3b3a6fc30842f6379bf6aadc88de975cb26f12c83062ab7e1d8b
size 3870225280

3
Chocotest14B-1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea88f32c5dc9e3821adb60908c9f771277853726dd91dd1fd49165ee63ef87f7
size 3605910400

3
Chocotest14B-1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81cdf4ab433770cb5ad1470cbbc71e64d54691c9e16acbd68a9b67e88b110a91
size 5353855232

3
Chocotest14B-1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9e75c5dc0537da4dd69d5feb51ff1cdc145eefc37c5ec768d3bb0ae6a96cbe1
size 5001435392

3
Chocotest14B-1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34d0d4f521f58359a889508e0587e9c8699bbe0d7bf89640120dfe672dca75fa
size 4702491520

3
Chocotest14B-1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55bb07ca1757146cdd9d723a6a62f096cba78ac13bd15d8fa0253e9ffde00bcf
size 4310750080

3
Chocotest14B-1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4414f415e09abc47bca6b700b1b84c390e59fbfbe775cdc73a3d9cbd657093cd
size 6913975616

3
Chocotest14B-1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ffaab483f33a31d1245e78c609e0d7a58e74d416c83bc35311954b07811a758
size 6690456896

3
Chocotest14B-1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb04825474be59071bdaa0b04144c15b1e657ebaca2198d5069db015eab8a170
size 6380799296

3
Chocotest14B-1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d25088ef093480e71fe2f55f8837c4c0444acffff32f917f9068402510d20dd
size 5944416512

3
Chocotest14B-1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7308e2f868eda42876fafb32d49cb65c4a037a0729cef6f3210ea149b6b899e
size 8546349408

3
Chocotest14B-1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c719b1f44e117697af12f13433d1a2a6108895d1a37742292eadeb036a1cb188
size 8117070528

3
Chocotest14B-1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:104b67744e2c19447decd14f6f983685888abf4328392e558df121e5573eeb56
size 5768142784

3
Chocotest14B-1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f43f054600b6692854c0f67bb0dd64269b03316b31b836256ae2f57a7ee42e4
size 5394833344

3
Chocotest14B-1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53e403c2e180132ae73bcb2597520cc2b8f853603618535a6068ee9065297c9d
size 7922206016

3
Chocotest14B-1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:599cf35e202ef89fc280a386d8d163577c71ff09d3c007e86784facb8d5767bf
size 7336641856

3
Chocotest14B-1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c06c7f2fd93a9cffd6c422256cdb49576d9761fb513bc1e27572d2554dbf925f
size 6657033536

3
Chocotest14B-1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76a09222ca0e33ac840631beda521c3d8b1a825128d6f848878b658b211f5e8f
size 8541434208

3
Chocotest14B-1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bd177e66071273603390b20de220b374e593686353d0b72840ad21d8653f9be
size 9389178528

3
Chocotest14B-1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c2a66636acba289e446875cbbbd559930c40b400d84387fb5a4702be1e16e84
size 8985276768

3
Chocotest14B-1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40948d4b62d3efed76c1972cfb241586ac3f6f26d508b1fc5d6a80e3083c4553
size 8570597728

3
Chocotest14B-1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00644641bb90c18a162f6a4528bd9869660656f7d3e0a444bcbc3b212afae9b2
size 10505784288

3
Chocotest14B-1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:025f3facd08f4b867547e0d81f4f07177e25b11c534b9d30c1b153ef7bcd302f
size 10263464928

3
Chocotest14B-1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b44aa6b715c9922fd0f6b2908e62f0484bac6b0f0b015bde8d232aafabbddfe
size 12121323552

3
Chocotest14B-1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81aa57492eba9c78d6a5a88c1f488854c22a869c253599fe5c46df953a94f359
size 8604128

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: jpacifico/Chocotest14B-1
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags: []
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/jpacifico/Chocotest14B-1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Chocotest14B-1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Chocotest14B-1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Chocotest14B-1-i1-GGUF/resolve/main/Chocotest14B-1.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->