mradermacher/shellwhiz-7b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/shellwhiz-7b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-18 10:40:09 +08:00
commit 54bd84ba45
27 changed files with 229 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
shellwhiz-7b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: AuricErgeson/shellwhiz-7b
datasets:
- AuricErgeson/text-to-shell-dataset
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation
- shell
- bash
- code
- qlora
- unsloth
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/AuricErgeson/shellwhiz-7b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#shellwhiz-7b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/shellwhiz-7b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/shellwhiz-7b-i1-GGUF/resolve/main/shellwhiz-7b.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
shellwhiz-7b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3857e7c335b1c4a94d10fc0c8054de3bebbedcc825f1860272f97fe8841dfe7e
size 2042197312

3
shellwhiz-7b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7579260c81b61b2c2aa357258fddcd677727b0449c501dd1bdc72a5d771008e
size 1903668544

3
shellwhiz-7b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:807c09ec50448df56bff253ace9f3dcba9e563591841010826f593ec3e312b17
size 2780343616

3
shellwhiz-7b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4d95b021a4f9377a4f92892b07268bf49d11b2573c71eb0ca07b0435b350d8e
size 2595638592

3
shellwhiz-7b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14670cc2988467cf6a435a28030b07df197c9eac62420806f529ad48ac9ddd6f
size 2469023040

3
shellwhiz-7b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ec2cb4a48474b109595d47fba404cc539b8c894be3cdf6058e0d8d95ca57dca
size 2273078592

3
shellwhiz-7b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:220d92da5ca1bde2c81f6aa1073b9d0b52b47148f17b87a4a638efa6e94382ea
size 3574013248

3
shellwhiz-7b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb68858e4620141e6dd2d957dc9fb73dec0da4136c569b15b4669c409f03ec1c
size 3499193664

3
shellwhiz-7b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d91bcc062fabd3393286c42e420bbb319f548b0967931b5f409675a1bbad17de
size 3346257216

3
shellwhiz-7b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a2c9ca5a1ae06c233027e44002321db89a5cc22d0f51375206df9ed6a3189b8
size 3114515776

3
shellwhiz-7b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d501901911501725802b5fbef7c8f61eb25cc3a0b01779010b07bb25075f6c5
size 4437814592

3
shellwhiz-7b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4364767081fa67070375a3c8070ade09ac473af8d546987a81ecd471a8167f64
size 4218473792

3
shellwhiz-7b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04e9d1bd69f55125625c17886732356d198f4d71bfa29f95d632d398ccbfde3b
size 3015941440

3
shellwhiz-7b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c00cd345448e46432b3e5f3f167c5f125dee3f56146e8bd11852faef5e62a0e4
size 2834074944

3
shellwhiz-7b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e4aa14894440afbb5153b9d985a37c81f75ceaee61000a903be4ca0634043ca
size 4088460608

3
shellwhiz-7b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f72eb4744c15c341b78581c6d248f78730bdc42d58f27711a72e35c0254207de
size 3808392512

3
shellwhiz-7b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d29b0e07bbbab751de8ea4c61fb5533704f6d1ec7d5e0ebc90b2ddf31262997
size 3492369728

3
shellwhiz-7b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97e8a616900343c1f5b491b005a0bebd0384f35ca7b99fa92c0dc8ec65cbb1f4
size 4444122432

3
shellwhiz-7b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61bb0dd9475a9804525cffc6372177af1e4c349b3dd237e9ce9e8809b95fada2
size 4873284928

3
shellwhiz-7b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a53b19ffae569fd5a0065d4f0a79de5037f913aad6e80fb13a455fcf1715b0bd
size 4683074880

3
shellwhiz-7b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dc8d25b6aebc3e1c1735df8e94f3fb112e86ed78723733c5b1410ec8c096201
size 4457770304

3
shellwhiz-7b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9a797aed844e8eafd0d0846d5bc525fb07963f92609b3a97fa4ca019ab3abaf
size 5444832576

3
shellwhiz-7b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:073f743c01f2316d0dfb4f9dede8265b883298f316233c25d4ffe78cf7423dd1
size 5315177792

3
shellwhiz-7b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f48333cdce76e083d141f284bae7949943abfae41da4e6971465edfb101c37b
size 6254200128

3
shellwhiz-7b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:742fa465ad58261c3c0dde613b1178c6f4791aa5857a1ba7ffd802c7c77ebe5f
size 4560352