commit a61542a92872be5a90a652739534116d90024a0e Author: ModelHub XC Date: Sun May 31 18:56:55 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Athena-1-0.5B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..9eb0d60 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,57 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Athena-1-0.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Athena-1-0.5B.i1-IQ1_M.gguf b/Athena-1-0.5B.i1-IQ1_M.gguf new file mode 100644 index 0000000..ce043e1 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4515f80fb2bf4deacb8740143a0722ece08a3b7e29e1f31ccf55020a93c5f46d +size 317975040 diff --git a/Athena-1-0.5B.i1-IQ1_S.gguf b/Athena-1-0.5B.i1-IQ1_S.gguf new file mode 100644 index 0000000..041f6aa --- /dev/null +++ b/Athena-1-0.5B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46dbd117022f2bd02d2681c13a9ae58c5e54ccb5d4d973eaa79d0650b97fdc04 +size 315830016 diff --git a/Athena-1-0.5B.i1-IQ2_M.gguf b/Athena-1-0.5B.i1-IQ2_M.gguf new file mode 100644 index 0000000..b31d1ed --- /dev/null +++ b/Athena-1-0.5B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:38dd237ed3c0c5d4214c1605329dbc2ee4134b048b9f7f6fa7d2a2e76a49cc13 +size 328598016 diff --git a/Athena-1-0.5B.i1-IQ2_S.gguf b/Athena-1-0.5B.i1-IQ2_S.gguf new file mode 100644 index 0000000..e1635a4 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16cf3191965f446da2da0fe35a52c7ad071d8d4a522773c35ed650836871a41d +size 325737984 diff --git a/Athena-1-0.5B.i1-IQ2_XS.gguf b/Athena-1-0.5B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..95d3057 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:44b567d7fc9fff062ff144d785d480d1e883a5a43dafef30377b439f3a771828 +size 324410112 diff --git a/Athena-1-0.5B.i1-IQ2_XXS.gguf b/Athena-1-0.5B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..95ead04 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ce108189a6a118922596a498db5cef332fa0a99a2286c7447136dbd339cfd8c +size 321550080 diff --git a/Athena-1-0.5B.i1-IQ3_M.gguf b/Athena-1-0.5B.i1-IQ3_M.gguf new file mode 100644 index 0000000..bda9c21 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb5735e2188ddc5c63b867bfa097cd3887489756ef30b385de35434939591a86 +size 342753024 diff --git a/Athena-1-0.5B.i1-IQ3_S.gguf b/Athena-1-0.5B.i1-IQ3_S.gguf new file mode 100644 index 0000000..af5b30d --- /dev/null +++ b/Athena-1-0.5B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:208b6c2645caa477c577f8fd3fc9575de6f97a10582f80e40eedcfb6ee97351d +size 338608128 diff --git a/Athena-1-0.5B.i1-IQ3_XS.gguf b/Athena-1-0.5B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..81cd44c --- /dev/null +++ b/Athena-1-0.5B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4d33aa383f357bc88dfb2b77532b8a7d51472a9511ec365cb635552b1d13426f +size 338608128 diff --git a/Athena-1-0.5B.i1-IQ3_XXS.gguf b/Athena-1-0.5B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..a8b8357 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:91fda20583da242a3dd3bb63fb893ea4171fe037380e04b65daeccc249e511a5 +size 333705216 diff --git a/Athena-1-0.5B.i1-IQ4_XS.gguf b/Athena-1-0.5B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..5723290 --- /dev/null +++ b/Athena-1-0.5B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af0245cee18306805af8fa9205101c8c51588df7034639630bab230d3cc75bcf +size 349403136 diff --git a/Athena-1-0.5B.i1-Q2_K.gguf b/Athena-1-0.5B.i1-Q2_K.gguf new file mode 100644 index 0000000..cfceffe --- /dev/null +++ b/Athena-1-0.5B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:062d35ba523f66aea92a268d73541d6c4c04d3e56db3f03295adb2e7e736e76b +size 338608128 diff --git a/Athena-1-0.5B.i1-Q2_K_S.gguf b/Athena-1-0.5B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..2be5401 --- /dev/null +++ b/Athena-1-0.5B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6da5aa5f078635070fa4001944f78704079324b28f0103ecfda23fc1fe08e3e +size 331049472 diff --git a/Athena-1-0.5B.i1-Q3_K_L.gguf b/Athena-1-0.5B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..f6fc116 --- /dev/null +++ b/Athena-1-0.5B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6765ced3b47cbb1d203757837ebd4ea4a3cb6661e24ac6ff91649363e8f71cfa +size 369358848 diff --git a/Athena-1-0.5B.i1-Q3_K_M.gguf b/Athena-1-0.5B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a9c15b8 --- /dev/null +++ b/Athena-1-0.5B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c81dcac56d8d15f878666066a18c8efdcbead3e412bd52e7ba8d325df6a9e4f +size 355467264 diff --git a/Athena-1-0.5B.i1-Q3_K_S.gguf b/Athena-1-0.5B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..338f3cd --- /dev/null +++ b/Athena-1-0.5B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce1997d3119d98dd1ae87eeb848c51fcd75907beb5a99758caa97f81776fc0e2 +size 338264064 diff --git a/Athena-1-0.5B.i1-Q4_0.gguf b/Athena-1-0.5B.i1-Q4_0.gguf new file mode 100644 index 0000000..b215497 --- /dev/null +++ b/Athena-1-0.5B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7636dc5bd892e9ba3b1ac40c2db62bca370f07f5fbcd9f9517f16f57a3a2c6f6 +size 352972800 diff --git a/Athena-1-0.5B.i1-Q4_K_M.gguf b/Athena-1-0.5B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..00333f8 --- /dev/null +++ b/Athena-1-0.5B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:52476f520856a171cf909ac56c95952480381fd6d6d95abcf95de935851aac17 +size 397808640 diff --git a/Athena-1-0.5B.i1-Q4_K_S.gguf b/Athena-1-0.5B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..7b28ba5 --- /dev/null +++ b/Athena-1-0.5B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:28163deebcf708ff74a43cb18ae7582ef27f024f362df8c82e2d69b3c17df035 +size 385472512 diff --git a/Athena-1-0.5B.i1-Q5_K_M.gguf b/Athena-1-0.5B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..1551dad --- /dev/null +++ b/Athena-1-0.5B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d547660064b040e665a4127ae7830f21777845a9554bb97ce3d0b18e190def91 +size 420086784 diff --git a/Athena-1-0.5B.i1-Q5_K_S.gguf b/Athena-1-0.5B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..8260785 --- /dev/null +++ b/Athena-1-0.5B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:72ebdacb8873f89b4676744e8ac9a26c53ac03bf5e1c5c2bad2d361db700b33e +size 412710912 diff --git a/Athena-1-0.5B.i1-Q6_K.gguf b/Athena-1-0.5B.i1-Q6_K.gguf new file mode 100644 index 0000000..93f421b --- /dev/null +++ b/Athena-1-0.5B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8570dcc8544013de9651914e45e067a694802993543c7d5ecc9b347ac980fc5 +size 505737216 diff --git a/README.md b/README.md new file mode 100644 index 0000000..88c7926 --- /dev/null +++ b/README.md @@ -0,0 +1,85 @@ +--- +base_model: aayanmishra-ml/Athena-1-0.5B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation-inference +- transformers +- unsloth +- qwen2 +- trl +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/aayanmishra-ml/Athena-1-0.5B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Athena-1-0.5B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Athena-1-0.5B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.5 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Athena-1-0.5B-i1-GGUF/resolve/main/Athena-1-0.5B.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..c13c253 Binary files /dev/null and b/imatrix.dat differ