mradermacher/TerminGen-32B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/TerminGen-32B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 01:33:09 +08:00
commit 74bf0c6d2c
26 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
TerminGen-32B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

89
README.md Normal file
View File

@@ -0,0 +1,89 @@
---
base_model: UCSB-SURFI/TermiGen-32B
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- terminal-agent
- bash
- devops
- error-correction
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/UCSB-SURFI/TermiGen-32B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#TerminGen-32B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/TerminGen-32B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ1_M.gguf) | i1-IQ1_M | 8.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ2_S.gguf) | i1-IQ2_S | 10.5 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ2_M.gguf) | i1-IQ2_M | 11.4 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ3_M.gguf) | i1-IQ3_M | 14.9 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 20.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.4 | |
| [GGUF](https://huggingface.co/mradermacher/TerminGen-32B-i1-GGUF/resolve/main/TerminGen-32B.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
TerminGen-32B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbc56627c05cd14762a6555ca1e5f01ced678d32ab4a84355af780b6e152d5b3
size 7932161344

3
TerminGen-32B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef48d2b6e5d58a5169087f5aa47b0a83f9e141974aef8213d6f244c7a5b1d130
size 7274507584

3
TerminGen-32B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:802e45a77a85928c2e99516cebdb9115148631660af3226deb84142f1115554f
size 11264441664

3
TerminGen-32B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:798213ad2ffc898b882b015f96bfcb2e1830a389384b1ba4ea435a96346be3e8
size 10387569984

3
TerminGen-32B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:824ee8f08808bb3ba1a64c947e507293aeade41a95ab8962af3131419318e0e3
size 9957551424

3
TerminGen-32B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:228fab9a6279cb660c480d40e788c3f1eab05b82934b456b46639e287fd89cfc
size 9028250944

3
TerminGen-32B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10c5d35abe593c153da38bb006622be673dc4320a6a88ccf5c91c3786cddea0f
size 14810123584

3
TerminGen-32B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59eae5cba4c7dbd95ad396555c9853f975ca7ac914f69530d682c65c16f11e22
size 14436896064

3
TerminGen-32B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d316ec52d5b9b2219dca90987319e2ece0be6b136becabd895ad4dc1d9e8c8e9
size 13705514304

3
TerminGen-32B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb609520b074881f183f04cab47d3bcc8e912ab9090f4c4a36ffaa65300f52e4
size 12839271744

3
TerminGen-32B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95697c8fb0e33e356e6615b4c1c1c6dd40cf98fd4196bf969565423d9e926cf2
size 17693154624

3
TerminGen-32B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c83240f8590101ca1a42a121dd3295e721fe1422fa2bd492fa7a4ce366f5e82
size 12313099584

3
TerminGen-32B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32bd5f891d045ea2f6982d055bb4275a84b674b7b22be31be724ee37229d4ff7
size 11488001344

3
TerminGen-32B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c781ceb3e34aec72fc36f35e6deb9176931a66ace0f8e1a5d8d55997cda22dd
size 17247079744

3
TerminGen-32B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8ba7b286b22db6d5bb2982191ac984ae9fb139cd18b126bc3f1ff6ecb335fbc
size 15935049024

3
TerminGen-32B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4bf06fc2ce6215d623204d3804b68bdb99efd1f89689c3c17f04fc677d38df5
size 14392331584

3
TerminGen-32B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c9ef71468589d40e1a37d6dab2dfc744277044fbb519f3f2882cb7daa16e404
size 18711010624

3
TerminGen-32B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed7f2bda6141c224628668bf035f36291bad68c0f15609942725c0599d0514ea
size 20639243584

3
TerminGen-32B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22fff225a741f324ddc9b752cf817ddf61e10913b845501caed34a424db74119
size 19851337024

3
TerminGen-32B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24a225011ff776faff156f705d6e7ae454cafec3f5eba5a3fe5c5e381e44d156
size 18784410944

3
TerminGen-32B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c845cc824b8a1ec1de329d705e9274c5f0ae892ba5e00e3bc2f148fed78fe07
size 23262158144

3
TerminGen-32B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b482de02e0801cdc72c661fdfcb6a090f5d0a0a3b5873f444fba7702d4411b94
size 22638255424

3
TerminGen-32B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d988dd94109f3e2338a117a205f2c6872f5bc2d3d4878fec97d538cfcc68a15
size 26886155584

3
TerminGen-32B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:172c441f6d7719cbc1a09c9fb1df22af120ecbd1c67b81e33243f4c4a46a1103
size 15011072