mradermacher/Heretic.Erudite-1B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Heretic.Erudite-1B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-11 23:34:22 +08:00
commit a14291a6c6
27 changed files with 229 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic.Erudite-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Heretic.Erudite-1B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f86ca76f89eebd3f960e65b063e2b50320ef884312724b6646aba879671bff2
size 643487168

3
Heretic.Erudite-1B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d2423b125f02ed0372d633b52ea1cd792892e85ad33c4425d440af246884f1d
size 639194816

3
Heretic.Erudite-1B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ee365c5b3bbab2439f67fc9818beb9278f997a4c329491056f90e5838dfdb51
size 669785024

3
Heretic.Erudite-1B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d787e2096084fa23d185dc4b062f13bb257e47b6fd3e77a875072814cd9319e7
size 664061888

3
Heretic.Erudite-1B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:603e06a6617afba7256124372d2f87e1b7971a6fd8a86e514dc8b7bdc8c29645
size 657322688

3
Heretic.Erudite-1B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dec6f60528e85dae9249f6311f11033143350f9b244213a7dbfb4f2b271c36d8
size 650641088

3
Heretic.Erudite-1B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:485fd3c900a41c94763f3a5ccd85dfd51c7947d99fc00929ff9a306543599182
size 697062080

3
Heretic.Erudite-1B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3dea6e4eb7e5287d881bcff324535322955def58cdd456610b11b456509b9a9a
size 689816000

3
Heretic.Erudite-1B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acf905da389d313fd59305e34469ae2d90aafabe79ed091447a7af39642ff612
size 689816000

3
Heretic.Erudite-1B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:842f09be34307b6262e9966a083c573711de4609b3f8839daeb38efcce486d04
size 680111552

3
Heretic.Erudite-1B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a96a5de72e160338368cafc18da3d07eecf715a3fc8fc9c625efe383249415b
size 721864640

3
Heretic.Erudite-1B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f711bbc589a28082317be4f0bc80418a396ab1b022c32986a01c6762aa8ceac2
size 714436544

3
Heretic.Erudite-1B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5816ed8993124523627ec247933eaad41aa9b04299443b237c8a87d8013ab495
size 689816000

3
Heretic.Erudite-1B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:475a7210f33e3509f852e6a2f055ba49ca90d7a2f511877c664615ec4288d1b5
size 671273408

3
Heretic.Erudite-1B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0eb951b0f430c656c86cdd5d70608143ce8b3d715398bd089dcb69616032007a
size 751577024

3
Heretic.Erudite-1B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f0940f498402d12dee677c7d997ff5d679bdd80e484ee269b57178d33df9fee
size 722417600

3
Heretic.Erudite-1B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:005d6660feb77dbc3a4b0ff61ad74604f7142b7e62b9f1b5f3224b16a4df32d7
size 688857536

3
Heretic.Erudite-1B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d72ae520c27e65246bfed5ee074542d9e9294f00bc6cfc49a16187b6f85927f
size 721919936

3
Heretic.Erudite-1B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7610bde6f97f24839e8447333e2e8df30bd1aebd243a537129467a8a63007b9d
size 764037056

3
Heretic.Erudite-1B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:675ee023c67038fe99a826026c88350fc1977ca647ef83d2c6a9b7442ed763e0
size 806059712

3
Heretic.Erudite-1B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44d7092bac5cd4a535ee88339198610d2f9a6f4dbb95f0baea752e0107235bb5
size 780994496

3
Heretic.Erudite-1B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6424e88afd047333f4d0f5749f27a096d587ed539f912b636f2e45645c3ea14
size 851347136

3
Heretic.Erudite-1B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31d9c70854d21b4a61de52083c1050c18d70d219b07a15dd0073419f3cdf0651
size 836401088

3
Heretic.Erudite-1B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01957414d15ef9922bc9c79e8ee75388303064ca67ab9102e16049ac897afc39
size 1011740096

3
Heretic.Erudite-1B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be026989abc51dd8b8c2381849fa2d32ed6d2d60781731fdba68b4edbe3acb8f
size 1452416

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: Novaciano/Heretic.Erudite-1B
datasets:
- Stormtrooperaim/Erudite-V2-250K
language:
- en
- es
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- 1b
- uncensored
- abliterated
- merge
- not-for-all-audiences
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Novaciano/Heretic.Erudite-1B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Heretic.Erudite-1B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Heretic.Erudite-1B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic.Erudite-1B-i1-GGUF/resolve/main/Heretic.Erudite-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->