mradermacher/heretic_Athena-2-0.5B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/heretic_Athena-2-0.5B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 06:56:15 +08:00
commit 9157da00ea
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
heretic_Athena-2-0.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: hereticness/heretic_Athena-2-0.5B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/hereticness/heretic_Athena-2-0.5B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#heretic_Athena-2-0.5B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q4_1.gguf) | i1-Q4_1 | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/heretic_Athena-2-0.5B-i1-GGUF/resolve/main/heretic_Athena-2-0.5B.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
heretic_Athena-2-0.5B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff43b3034739d3ee4e1ceddea79164c91a0ecc1d22383c9d9868d4acca750767
size 317974944

3
heretic_Athena-2-0.5B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4dd3a97aaa831587711b880c4cac8d0144be0111adbca71758b3649449f83f41
size 315829920

3
heretic_Athena-2-0.5B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ac477cb89043cb87fcbb1447799614c09a06d45d37053cf5fd172771d0010ec
size 328597920

3
heretic_Athena-2-0.5B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:930813db9a8b78122eadb1b9ba159523ea7824ff60bd6640a3274c2baadedbf3
size 325737888

3
heretic_Athena-2-0.5B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68eab770248e15a382af7a8f4689d6aa5b9d524311684d45adb15d33ac4b4bba
size 324410016

3
heretic_Athena-2-0.5B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2df476e1424e50426d4d20284ea6403aa35891bb679936463fe4dc17f04e68b4
size 321549984

3
heretic_Athena-2-0.5B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48fac012f3eab1c36d230c7ee02fb80b990a63e3beb5663eea462fd6fbbad9b9
size 342752928

3
heretic_Athena-2-0.5B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd30359dd9f68b5b4cf77c4559044262092c7855443c97b4c3f032298a4c956c
size 338608032

3
heretic_Athena-2-0.5B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:626865919c92f210798f31ffd015235912f1804946f1845ca294afad39650cfb
size 338608032

3
heretic_Athena-2-0.5B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94538596ad7dc3d9e61cb21bb48672ea59334d3583fd109aedb24b589d15448e
size 333705120

3
heretic_Athena-2-0.5B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07676095260e6d1f97741ed294a8282d82a9189d94285c177b135de8632ac6c7
size 352671648

3
heretic_Athena-2-0.5B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1f12e629c1c5d1cb217031659a77086cffc93bddcd21741bb0845918a31d647
size 349403040

3
heretic_Athena-2-0.5B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ccdb04727bd3432e4135e24559c0af415a76b8ccf334183e7ff585ea1a20fa9
size 338608032

3
heretic_Athena-2-0.5B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbaa294afed657dc862c8e6364d589058ae6b7e1fcdfad7027db1772425daba0
size 331049376

3
heretic_Athena-2-0.5B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:156c88e38aba25d27210204aa3a0055edba475934d91cb6ba5dcbb76e4091258
size 369358752

3
heretic_Athena-2-0.5B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7741e7958f23b1580be81c778053444e900b23703692e9b92e8aba8e6df51675
size 355467168

3
heretic_Athena-2-0.5B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:323c8bb5a9e2f9868f730820086a886968e37f55fe1b32f89c605f2b35d5ee88
size 338263968

3
heretic_Athena-2-0.5B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a474e18b03bd7867fa206b42ebe980f1e7d6b895e463589df6b6bb421fc1d42
size 352972704

3
heretic_Athena-2-0.5B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb417b144b3a75f8315c7a586e3974751538c19539938eec2db3961e43f41443
size 374519712

3
heretic_Athena-2-0.5B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47b7af6b0584481f9e8d748099b982b888cecd8725ea566dcb59897511ae89f0
size 397808544

3
heretic_Athena-2-0.5B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f11332c34a3d38e305b9f52db8477aac42f086a78d51c6a657121299456fbdb
size 385472416

3
heretic_Athena-2-0.5B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3204af9986985ffbc4b7d3bdad82bfc722cee2d35597d79f0687ebf6ff25be3
size 420086688

3
heretic_Athena-2-0.5B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ab8d34ef43954d349a5944d734cfbc7943e92c9a03dbc87fe10bba1df3bc6ae
size 412710816

3
heretic_Athena-2-0.5B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13c4f16f92f17090615e3cc392a5b1716dbbdbc530fa937c9938075b318c0d88
size 505737120

3
heretic_Athena-2-0.5B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8bf094f081003575c0cca42817e2a65573bdae09fc72ade28a97169a0b4f567b
size 1008928