commit 56f6af130eb7f3f33ebf60e42ba60faa1897b2af Author: ModelHub XC Date: Wed Jun 17 20:21:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Atem-Wisdom-1.5B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..48f9d5f --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Atem-Wisdom-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Atem-Wisdom-1.5B.i1-IQ1_M.gguf b/Atem-Wisdom-1.5B.i1-IQ1_M.gguf new file mode 100644 index 0000000..7471d12 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a13c26ebcaa9d1a622d2936d787545f7ecfcda7afd7ef0f080c70835166011aa +size 464463872 diff --git a/Atem-Wisdom-1.5B.i1-IQ1_S.gguf b/Atem-Wisdom-1.5B.i1-IQ1_S.gguf new file mode 100644 index 0000000..a8f0cd2 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7dbffc96911b3743fa4380bb6d4665f8dad589e9188dd70c6a79c97571eb6462 +size 436530176 diff --git a/Atem-Wisdom-1.5B.i1-IQ2_M.gguf b/Atem-Wisdom-1.5B.i1-IQ2_M.gguf new file mode 100644 index 0000000..613d794 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c54bcafaac843ac05bdf82c8c4b66c6c11fc4c037f1baceaedcf9af2f74d244f +size 601057280 diff --git a/Atem-Wisdom-1.5B.i1-IQ2_S.gguf b/Atem-Wisdom-1.5B.i1-IQ2_S.gguf new file mode 100644 index 0000000..2c8510e --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1c56e8fb1367c564a129620a132771bc9f5903c27c59d515c9fff859226b6704 +size 563812352 diff --git a/Atem-Wisdom-1.5B.i1-IQ2_XS.gguf b/Atem-Wisdom-1.5B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..6c1d45e --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:114406c025f0eaad793a29a6866002ac6ff8da7a24e533216f8c43cd4ab0c49b +size 550329344 diff --git a/Atem-Wisdom-1.5B.i1-IQ2_XXS.gguf b/Atem-Wisdom-1.5B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..f94d6d6 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3b7c27c608a38d60ce1af1b80116e38e88e2ff1c8b0c0b9318cb2af9c0a6c1a +size 511020032 diff --git a/Atem-Wisdom-1.5B.i1-IQ3_M.gguf b/Atem-Wisdom-1.5B.i1-IQ3_M.gguf new file mode 100644 index 0000000..d462254 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93c206000d4d02a13d9e5e139646060eedfeb3b1814c4e99ac679334e0bf1b3a +size 776666624 diff --git a/Atem-Wisdom-1.5B.i1-IQ3_S.gguf b/Atem-Wisdom-1.5B.i1-IQ3_S.gguf new file mode 100644 index 0000000..41e3f45 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4b29e5e7e0039dd2083b1ed30467383de1813c08b7a94b345dd7f827ab7e0f1f +size 762409472 diff --git a/Atem-Wisdom-1.5B.i1-IQ3_XS.gguf b/Atem-Wisdom-1.5B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..5d5d364 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c13a249d0030e8499ce66b8e1c8799fee2c19e213789ede44eef3fce03d8c8b +size 731701760 diff --git a/Atem-Wisdom-1.5B.i1-IQ3_XXS.gguf b/Atem-Wisdom-1.5B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..b35d6b1 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b816decc42d86ca9362888c1d0f84482a80f6a67707ce3f1eaac89a1ad06f41 +size 668794880 diff --git a/Atem-Wisdom-1.5B.i1-IQ4_NL.gguf b/Atem-Wisdom-1.5B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..cf34fdb --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85e7e8379ceafd17eec492b2940a7f94d0c46a08d0caec15a2f1333ef3e91f4c +size 936333824 diff --git a/Atem-Wisdom-1.5B.i1-IQ4_XS.gguf b/Atem-Wisdom-1.5B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..b801639 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d73253b0fc7a38887be8776b452616f9acb727743faecea40a7386f4fcef04fe +size 895734272 diff --git a/Atem-Wisdom-1.5B.i1-Q2_K.gguf b/Atem-Wisdom-1.5B.i1-Q2_K.gguf new file mode 100644 index 0000000..5d2b364 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17189d9a8b3daa8ee439f52ab3f2f1ee9483ec04fceb916e0ba5b61e1c2aa668 +size 676307456 diff --git a/Atem-Wisdom-1.5B.i1-Q2_K_S.gguf b/Atem-Wisdom-1.5B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..1190d89 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1e136a0734450bd956b8e08aaefe5d9c5f8b61ed24bb3f5468d1ce611d69019 +size 640137728 diff --git a/Atem-Wisdom-1.5B.i1-Q3_K_L.gguf b/Atem-Wisdom-1.5B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..55f1e75 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43a45417190734c3661946a0bf4f3e8e1f388ac38d6e80754a52c6cbeee3e6d1 +size 880165376 diff --git a/Atem-Wisdom-1.5B.i1-Q3_K_M.gguf b/Atem-Wisdom-1.5B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..1e72604 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4d72c7de98d320853ae31706a28e9a6fbc5507d814614123f0fa8822b2271cae +size 824181248 diff --git a/Atem-Wisdom-1.5B.i1-Q3_K_S.gguf b/Atem-Wisdom-1.5B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..acb949a --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e306643574de789fcaf2b59e6cb6b272d2c6ff22b1bfd193b8882a94cb502bf +size 760947200 diff --git a/Atem-Wisdom-1.5B.i1-Q4_0.gguf b/Atem-Wisdom-1.5B.i1-Q4_0.gguf new file mode 100644 index 0000000..ff6662f --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:78e2d1ac6bd26e01ff22d0d4a350cd3e871938b2b0014cac1c2485e4c9b23b37 +size 937538048 diff --git a/Atem-Wisdom-1.5B.i1-Q4_1.gguf b/Atem-Wisdom-1.5B.i1-Q4_1.gguf new file mode 100644 index 0000000..8fda0e4 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e77843ef4ca66ffd7eae32313b05dba0581a7e3b30a6218e077ec77bfa25380e +size 1016844800 diff --git a/Atem-Wisdom-1.5B.i1-Q4_K_M.gguf b/Atem-Wisdom-1.5B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..64e6387 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a444e1fc430e019180067d9bd67813c984ae6b140cf8c0581ab6298fd86c3b9 +size 986051072 diff --git a/Atem-Wisdom-1.5B.i1-Q4_K_S.gguf b/Atem-Wisdom-1.5B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..77c6a83 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d664ea95da41210862bd2794f14f6f6e8f02afb8fa001a40a4f2087ecbc19bad +size 940315136 diff --git a/Atem-Wisdom-1.5B.i1-Q5_K_M.gguf b/Atem-Wisdom-1.5B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..9577be0 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dadb093340be4a3e08aa57a5777406f8366a49bca035b20c8566ad331e83fbd5 +size 1125052928 diff --git a/Atem-Wisdom-1.5B.i1-Q5_K_S.gguf b/Atem-Wisdom-1.5B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..9436527 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e431ff27ba34a7af95297de8cb7b12d231884e454c78240ce3d2d24dd521987 +size 1098732032 diff --git a/Atem-Wisdom-1.5B.i1-Q6_K.gguf b/Atem-Wisdom-1.5B.i1-Q6_K.gguf new file mode 100644 index 0000000..4661138 --- /dev/null +++ b/Atem-Wisdom-1.5B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:27ec26dfd4c64305b99a47567870bf2d216a85981a4179a1fb39d7a3b6cddb20 +size 1272742400 diff --git a/Atem-Wisdom-1.5B.imatrix.gguf b/Atem-Wisdom-1.5B.imatrix.gguf new file mode 100644 index 0000000..f62525d --- /dev/null +++ b/Atem-Wisdom-1.5B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d956120e454fbf59728783b3f395330432a922f649a38165fd185f584fb9f991 +size 2065888 diff --git a/README.md b/README.md new file mode 100644 index 0000000..8c58855 --- /dev/null +++ b/README.md @@ -0,0 +1,103 @@ +--- +base_model: EphAsad/Atem-Wisdom-1.5B +datasets: +- open-r1/OpenThoughts-114k-math +- Jackrong/Kimi-K2.5-Reasoning-1M-Cleaned +- Modotte/CodeX-2M-Thinking +- FreedomIntelligence/medical-o1-reasoning-SFT +- WithinUsAI/MiniMax_M2.7_Distilled_5k +- nvidia/OpenCodeReasoning +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation +- qwen2 +- unsloth +- lora +- gguf +- llama.cpp +- reasoning +- chain-of-thought +- thinking +- distillation +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/EphAsad/Atem-Wisdom-1.5B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Atem-Wisdom-1.5B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Atem-Wisdom-1.5B-i1-GGUF/resolve/main/Atem-Wisdom-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +