mradermacher/heretic_Genuine-1B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/heretic_Genuine-1B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 07:26:15 +08:00
commit 098043140c
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Genuine-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: hereticness/heretic_Genuine-1B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/hereticness/heretic_Genuine-1B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#heretic_Genuine-1B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/heretic_Genuine-1B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Genuine-1B-i1-GGUF/resolve/main/heretic_Genuine-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
heretic_Genuine-1B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:424e7b57e8ebfd26d16d8d6becf2de4b877d565fc62d9d90c91e853193f850d0
size 643486464

3
heretic_Genuine-1B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69a172ff38d80b5ca21d80ba85fa3c843808e06116ac35620567989de677ee88
size 639194112

3
heretic_Genuine-1B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:626c1c021a1360fcfe3d9d1375c71227f16b92e3f77c1e705faf6b50d62ef883
size 669784320

3
heretic_Genuine-1B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a7ec676f6317c9ad3fdab4be6225cff1766b08500f42792a10dd03655fb57bb
size 664061184

3
heretic_Genuine-1B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13d510dcb111bdec34bb0ebfd52b5512101ec9e7f88e34a61a714043dc278b18
size 657321984

3
heretic_Genuine-1B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d732101eee5f7d4ca53da0876d9c7bcb3592f4b2c2a3d00d566c3e0b56d92df
size 650640384

3
heretic_Genuine-1B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c663343320473a4223ad2b183897336f5bb53df9b18e994bbe885b8d32e792fd
size 697061376

3
heretic_Genuine-1B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8b78c9e6452867a52302d065ec6d673a6d77fdf44c86a74873b207b0c21e647
size 689815296

3
heretic_Genuine-1B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2a2106b91782d45250e58db40837118f40f013a86dd93547a04c5aa13882fb4
size 689815296

3
heretic_Genuine-1B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3234a4776e5f54be54d2dcf1c971225c363868a14849f812efbbbc12111017cc
size 680110848

3
heretic_Genuine-1B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b6c5237e71917adc67372f199e5385ffd8d6f6c46233de2090e32dba461ec57
size 721863936

3
heretic_Genuine-1B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:257881f9224842886a081e0c5c54862be317d8e2590e4d692d937f4c9382034f
size 714435840

3
heretic_Genuine-1B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ae5e03ca652c810cd3442fa52470370b1209d5fb94968ad5ed3460179e2d8c7
size 689815296

3
heretic_Genuine-1B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6893ed7aa76170196881e0c86649e6f0edb7e6765cbf232d7b04aa2278889de6
size 671272704

3
heretic_Genuine-1B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffb22aba341d880dcf42b0a0dc131a71d3b6452b8922ee6898f80e2aa0302a1f
size 751576320

3
heretic_Genuine-1B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e86408fa4853d7399ad65bb12fe5aa355e9ca35c8167ae849f4e167e413b7629
size 722416896

3
heretic_Genuine-1B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8033d9de0ee4171dbb1f66019810d91b132d715af8e55f049095f6fad3232c03
size 688856832

3
heretic_Genuine-1B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08c20edeb427e7060bfe7dd6c8a9d688ca2b49751b15601c5a7ad7c6c99abe77
size 721919232

3
heretic_Genuine-1B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0dff5f0c664018ef378b7630786d6ac40250572a5e8845e62c9c8c06a92f7d5f
size 764036352

3
heretic_Genuine-1B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14c04cd149f0fa41f2c0a942ee7435e2ef3463985249f0f0dca329d847e26bf4
size 806059008

3
heretic_Genuine-1B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d0bd64c151db2b3bf0f17edd071d7ecb3cf5fa95c32beaa147588e3f01526d2
size 780993792

3
heretic_Genuine-1B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29b9b96745e3ec8fc632d923f590a465d34c2eceded66056c2d67c15fe548620
size 851346432

3
heretic_Genuine-1B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20d2a83e09b83f1b716b07a5ee9961946a3e0e6db9cb5eaee6750cc816e0d84e
size 836400384

3
heretic_Genuine-1B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:671b7ee2071e6e21097201730beb54420cb1324dbf4f165fbda672b380edbebb
size 1011739392

3
heretic_Genuine-1B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b2c347a1cb7b674248f12ce2e252bea71a3f4ff8585eb8c4ffbacfad57cc109
size 1452416