mradermacher/Heretic-Reasoning-0.5b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Heretic-Reasoning-0.5b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-15 01:30:44 +08:00
commit 67dd3ac807
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Heretic-Reasoning-0.5b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Heretic-Reasoning-0.5b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73bc66e42fba2fd2e6063548a4cd53602d3d00c19c949c1c6b72912b1fb90281
size 317972736

3
Heretic-Reasoning-0.5b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d39a935c8191976098036310d3d559e050104df58fb782466453deb4665269f
size 315827712

3
Heretic-Reasoning-0.5b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0e8e8ed0fe2b5af03d0abd8380e47a0454f8515b9dfc2fa0b28f28df51c3284
size 328595712

3
Heretic-Reasoning-0.5b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdd5906e36b3747fefa2c04664d0f3431eb3cfd7152880a9b596c6c5d91a26a8
size 325735680

3
Heretic-Reasoning-0.5b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edc04c2336a0047e563c47bb659eeeb7534bc0e3b95f7232e214ffbb32941522
size 324407808

3
Heretic-Reasoning-0.5b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6995ddf486484425556e5a35c4429f0ef547424348e3fd06c3a06cfa4dfe15f5
size 321547776

3
Heretic-Reasoning-0.5b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc214403132e32ba50fe7082deb9a69e412e221aa02916c103413706b4434d6f
size 342750720

3
Heretic-Reasoning-0.5b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bad023d6fd493412520e558573cafa51bb029b600c83c1b8cdee6bded9b5502
size 338605824

3
Heretic-Reasoning-0.5b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0731bd14ed09be44300168d5ae5eb3c0ffa399024e9b89b7fd677c9c3bf0272f
size 338605824

3
Heretic-Reasoning-0.5b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df24c70ec247aebdef80d008f98b67aae8007e7c9d858f6660d0601be144dab5
size 333702912

3
Heretic-Reasoning-0.5b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:639fe399a48a6649dd86d81d0ecdc096c219c7183528ec1cc5fd6d13f4b4679b
size 352669440

3
Heretic-Reasoning-0.5b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f28ddb958594ac7003e55c86c2aded29b08fee22c50051c035cedc47af6baf8d
size 349400832

3
Heretic-Reasoning-0.5b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a342c12dcc8c7c1e9fc6ed0103077b306e6cd1deb2a507dc9adaee9430fcd959
size 338605824

3
Heretic-Reasoning-0.5b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5378438eece444b5538f3c85e10f21f1db37b76af1c0013d99bce8600590ce6
size 331047168

3
Heretic-Reasoning-0.5b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:656fedf92483442022d6be6daae911bb01884b3dd4edc58b065e15d364bd6459
size 369356544

3
Heretic-Reasoning-0.5b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b23510ed647996ce33c513093c844d92c3117ddeb9f46758bb440a8fa15039a0
size 355464960

3
Heretic-Reasoning-0.5b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:716c234ffd5d7ef1316920c1c5dbc42060398d6addb94f3a08092026000ea1b8
size 338261760

3
Heretic-Reasoning-0.5b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26976ffdfbd9c095b98541cd0b23e35ed188cebb6117292a1b4af0d6cd1dc4a4
size 352970496

3
Heretic-Reasoning-0.5b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8febe82cacb091e62734b9b9730e0de2e165bf9d199741ddfa8879d615616fb
size 374517504

3
Heretic-Reasoning-0.5b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c47a90ee84d6c8cdef458776f95c313fd1b20c63f922aea7014ee53a7347d005
size 397806336

3
Heretic-Reasoning-0.5b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9c6872e52a0b334612f2a850a316f31debfcfb6de86f95df9b1958823227c33
size 385470208

3
Heretic-Reasoning-0.5b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:847d3e7997d5d9a056b8404662dbdc17957abeb6e499de96e230ab0f32d885f0
size 420084480

3
Heretic-Reasoning-0.5b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31dab42252ad3e1f0bf95da3578043c75efce23e29d223f6dab6b11cb1423a65
size 412708608

3
Heretic-Reasoning-0.5b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b8306eb983bb2314be6d329573ab9b33f33c45644ef358f030be750cc2e67d5
size 505734912

3
Heretic-Reasoning-0.5b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4f137d4ec19a7103d146a7f9311aa76dc68e64d7c72a1037c269f2d50d33265
size 1008928

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: hereticness/Heretic-Reasoning-0.5b
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/hereticness/Heretic-Reasoning-0.5b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Heretic-Reasoning-0.5b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q4_1.gguf) | i1-Q4_1 | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Heretic-Reasoning-0.5b-i1-GGUF/resolve/main/Heretic-Reasoning-0.5b.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->