mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-13 00:07:57 +08:00
commit f12c78d6b8
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Wicked-Nebula-12B-Heretic.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Sorihon/Wicked-Nebula-12B-Heretic
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Sorihon/Wicked-Nebula-12B-Heretic
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Wicked-Nebula-12B-Heretic-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/Wicked-Nebula-12B-Heretic-i1-GGUF/resolve/main/Wicked-Nebula-12B-Heretic.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Wicked-Nebula-12B-Heretic.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1dc0443878fff0e4b85f748f0650d2ee18677924aa3a6f4074a50a0bb0c54c6
size 3221640288

3
Wicked-Nebula-12B-Heretic.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cf103b057b0ff0abfd5f8443d2fe93b12de20da3ef8facf29922fbbc9d3d601
size 2999227488

3
Wicked-Nebula-12B-Heretic.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95311a08d89c0361df350b5b32a161db07a7202bf5f6b323cfc64f1e6a0a605b
size 4435040896

3
Wicked-Nebula-12B-Heretic.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:261f509ba5f68fbaaceec8ab498e1b87c499e31f79fe426c85794725c483b240
size 4138490496

3
Wicked-Nebula-12B-Heretic.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21f5f88072f83bf11601b7e96841f369a03a98322b9771ea6b8ce830aa5389f7
size 3915093088

3
Wicked-Nebula-12B-Heretic.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80de6bbfa42af1eb626d8aeb5272d12e939a5d7ae6ccf2f7b40d6b8a98f78338
size 3592328288

3
Wicked-Nebula-12B-Heretic.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0dbd249966e87e196fc260e2a40bc93708e464d0f53fbc3ee333b941c30157c7
size 5722251904

3
Wicked-Nebula-12B-Heretic.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:678040671aafab36ee05c6bce8342b562a02125982993ed74ede7fe03a6fa342
size 5562098304

3
Wicked-Nebula-12B-Heretic.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee660aa25cccd5a489670ab751324f25a8b74de13b4969ae63e30b91bcd58272
size 5306507904

3
Wicked-Nebula-12B-Heretic.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aac69de8776776904050f6707e74cc370a0f89b4a578156fef8bd5ea105483c0
size 4945402496

3
Wicked-Nebula-12B-Heretic.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36f8ebc73f23b6e4ab854cf981fbd8539edad3219b2e1f742fad3b63867bc070
size 7097936480

3
Wicked-Nebula-12B-Heretic.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c443bcc87e12d58919bd5fc88b57c62d2a0d25fa24894f78d9167718ee9160d
size 6742730880

3
Wicked-Nebula-12B-Heretic.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7049919633b77270cf03c73b2fc2154ed5f61827d207f98f092121454921ebd0
size 4791065696

3
Wicked-Nebula-12B-Heretic.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:198f7b0dae5554a49ceba58215165cf5b69d027d52aa19c43a2e9f1086611fe8
size 4493696096

3
Wicked-Nebula-12B-Heretic.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48ddfb6d3acfed0dc7c8b4532ef68eacaa74708c4f1c1a0c8fa469233b6b85e5
size 6561522304

3
Wicked-Nebula-12B-Heretic.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:227110384466854d37a1e847a9b6e0a1004dd96b6fabdf8549f420f8bf1d4427
size 6083109504

3
Wicked-Nebula-12B-Heretic.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c110505b38c476f5dad349f676767182bc50557fdf9a37bdce1035bdc4e27c3d
size 5534245504

3
Wicked-Nebula-12B-Heretic.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:680d00f2227687835115f974722bbeb8c3a0fb5f5f4b9b04708866afb30df15e
size 7094659680

3
Wicked-Nebula-12B-Heretic.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c536e51b10b4d3eb377088f47fb294c97dc42e0f56f407c213d88cd0d586cfdf
size 7795240480

3
Wicked-Nebula-12B-Heretic.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ef3afe0d2a9ff383454ccc22959341fb42c3ed2bee7233fc942bc8ba576b161
size 7477226080

3
Wicked-Nebula-12B-Heretic.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9934e8169aa79534d9a43a0e82349b2b981296438d0b3577b8d2c7f3df393bca
size 7120218720

3
Wicked-Nebula-12B-Heretic.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9207a6e194aa05a108b350dc03a1896ba50264dbd8eb479bf4b41d3eb74db7da
size 8727654880

3
Wicked-Nebula-12B-Heretic.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2dc393203ef12d03cfda02ce917902ca36f6975f2d81fcc5d1ea22007f09cd18
size 8518758880

3
Wicked-Nebula-12B-Heretic.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8603bb4205945dc80e6ed770064e14f4adf1481ff0e4301dd6b05c19bc63b20f
size 10056235488

3
Wicked-Nebula-12B-Heretic.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d42c94a2dc8e9c853d475661f3b68f6092d8c6179936d722729a390c39336afb
size 7088192