commit 500bea9815a0e71c8e872ca2fbb6d68d66582fd0 Author: ModelHub XC Date: Sat May 9 00:20:19 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Gemma3-Emotional-1B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..1064e56 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma3-Emotional-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Gemma3-Emotional-1B.i1-IQ1_M.gguf b/Gemma3-Emotional-1B.i1-IQ1_M.gguf new file mode 100644 index 0000000..4fa1a27 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f91935316863722652f8d736090d4c44dc630551f66eb82064403eb8e3e9bcbd +size 643485088 diff --git a/Gemma3-Emotional-1B.i1-IQ1_S.gguf b/Gemma3-Emotional-1B.i1-IQ1_S.gguf new file mode 100644 index 0000000..9d0dd29 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3d61aea1903de6d31cf26a07a2c70b52107d1c0da7b5f33f0d7b6d8432813b98 +size 639192736 diff --git a/Gemma3-Emotional-1B.i1-IQ2_M.gguf b/Gemma3-Emotional-1B.i1-IQ2_M.gguf new file mode 100644 index 0000000..f506b20 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:374fb59c123c16e5697aa129e201a3db764e683ad4789f9924c0c9fcc53aea2f +size 669782944 diff --git a/Gemma3-Emotional-1B.i1-IQ2_S.gguf b/Gemma3-Emotional-1B.i1-IQ2_S.gguf new file mode 100644 index 0000000..7d7bf79 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7460f474b02bfb596eb60e99b6ef056777b2ed2eeee332034cbee5af6d6498f8 +size 664059808 diff --git a/Gemma3-Emotional-1B.i1-IQ2_XS.gguf b/Gemma3-Emotional-1B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..027800e --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4830b3512408369cf45f31b658b7def3bac2cf0f980935f8f961cdb04af1fd0 +size 657320608 diff --git a/Gemma3-Emotional-1B.i1-IQ2_XXS.gguf b/Gemma3-Emotional-1B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..025c3d7 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bcc45662d558ff1864d87ad4b13c3d82db7da7dec4f714cad8226ce1e9983e21 +size 650639008 diff --git a/Gemma3-Emotional-1B.i1-IQ3_M.gguf b/Gemma3-Emotional-1B.i1-IQ3_M.gguf new file mode 100644 index 0000000..7d8f16d --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93e4ec36e773d4c74dfb938932ad3001aa75d9625613776ba7c50cf83f113bdd +size 697060000 diff --git a/Gemma3-Emotional-1B.i1-IQ3_S.gguf b/Gemma3-Emotional-1B.i1-IQ3_S.gguf new file mode 100644 index 0000000..98ce3da --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37b166cec70e44de1949a9a2970e5a1b0e86e40543bd913667ba2c2b92973e80 +size 689813920 diff --git a/Gemma3-Emotional-1B.i1-IQ3_XS.gguf b/Gemma3-Emotional-1B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..8cc3adc --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20a8354ff2ea0207910d61e2af05201bffe30289d39e00c5f8a8463a955c340b +size 689813920 diff --git a/Gemma3-Emotional-1B.i1-IQ3_XXS.gguf b/Gemma3-Emotional-1B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..f1d3009 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:facbb8e846b9b3f6e508c223cb778ecc64ff4f5e78b3a4e712ad59f65233abfa +size 680109472 diff --git a/Gemma3-Emotional-1B.i1-IQ4_NL.gguf b/Gemma3-Emotional-1B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..54f2e82 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9989df01c9be983005793a2f05fbebfc4dd6b626a596190c12588652af756714 +size 721862560 diff --git a/Gemma3-Emotional-1B.i1-IQ4_XS.gguf b/Gemma3-Emotional-1B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..6b05265 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd5aec6dd45da79b76eef8b15744bd12babc7a72fe6ceedd1d597b4f54282086 +size 714434464 diff --git a/Gemma3-Emotional-1B.i1-Q2_K.gguf b/Gemma3-Emotional-1B.i1-Q2_K.gguf new file mode 100644 index 0000000..d133787 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:145d035e8c3c7e4a0809e8a221f17951c9b34b55b43e1c8711d0a5d8ec6344dd +size 689813920 diff --git a/Gemma3-Emotional-1B.i1-Q2_K_S.gguf b/Gemma3-Emotional-1B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..bb964fc --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08a73fb19440460dff1292c69fe3c9fdb5dc1226f36c6028f47d9189b8b25132 +size 671271328 diff --git a/Gemma3-Emotional-1B.i1-Q3_K_L.gguf b/Gemma3-Emotional-1B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..f149c2b --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:105429ace1b14796480075b04b630a60c7c57da03be1c0db959d7c55d53c6226 +size 751574944 diff --git a/Gemma3-Emotional-1B.i1-Q3_K_M.gguf b/Gemma3-Emotional-1B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..19c59dc --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c12f8820ba9ce772c771c6141469d9e45e2087ad9dc4fa3d49c12c6fc9291554 +size 722415520 diff --git a/Gemma3-Emotional-1B.i1-Q3_K_S.gguf b/Gemma3-Emotional-1B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..10ae183 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e159762b8ee7222b5ab403eb1f780ddbdf3725916f916eb5584fe96e637248e +size 688855456 diff --git a/Gemma3-Emotional-1B.i1-Q4_0.gguf b/Gemma3-Emotional-1B.i1-Q4_0.gguf new file mode 100644 index 0000000..711460f --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f03b8dff224294d689b5f97c7e5150211a90ee5dd0b697dfbca02e5724f55cb +size 721917856 diff --git a/Gemma3-Emotional-1B.i1-Q4_1.gguf b/Gemma3-Emotional-1B.i1-Q4_1.gguf new file mode 100644 index 0000000..a413ef3 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a92359628ede10a88e1994fc75f6bfe3be3769f3f39bfe86285f436be9f43ee8 +size 764034976 diff --git a/Gemma3-Emotional-1B.i1-Q4_K_M.gguf b/Gemma3-Emotional-1B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..43503bc --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:38ed019d95c103532c2035c36537e73831d3b840c40bcaab799ca0d5929b8ba5 +size 806057632 diff --git a/Gemma3-Emotional-1B.i1-Q4_K_S.gguf b/Gemma3-Emotional-1B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..a6db2da --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:15c6c50d33d6153c645b2a5e5f1e9c28f9b696a2be5bb76da1ae398f0daa6057 +size 780992416 diff --git a/Gemma3-Emotional-1B.i1-Q5_K_M.gguf b/Gemma3-Emotional-1B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..d1b0455 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a17efa72013596df102bed22012f5d17131fbb3b7e5c6f0128b3239048d241f8 +size 851345056 diff --git a/Gemma3-Emotional-1B.i1-Q5_K_S.gguf b/Gemma3-Emotional-1B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..ff91ad2 --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c873a5cb761c2c35ff9e9d8c1778235265a26a6f76b4b70520826db12acf9ba +size 836399008 diff --git a/Gemma3-Emotional-1B.i1-Q6_K.gguf b/Gemma3-Emotional-1B.i1-Q6_K.gguf new file mode 100644 index 0000000..54d31da --- /dev/null +++ b/Gemma3-Emotional-1B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa2b46ec1d198b1a6bd834bec1230b1f0149627d5907bedaf2021dd03a8761e5 +size 1011738016 diff --git a/Gemma3-Emotional-1B.imatrix.gguf b/Gemma3-Emotional-1B.imatrix.gguf new file mode 100644 index 0000000..acbbd40 --- /dev/null +++ b/Gemma3-Emotional-1B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:50027a0257c8b01719be6732825e90e226af0aee49e8417441c03f5aedb3dc99 +size 1452416 diff --git a/README.md b/README.md new file mode 100644 index 0000000..5ec6703 --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +base_model: Novaciano/Gemma3-Emotional-1B +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- mergekit +- merge +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Novaciano/Gemma3-Emotional-1B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Gemma3-Emotional-1B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Gemma3-Emotional-1B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Gemma3-Emotional-1B-i1-GGUF/resolve/main/Gemma3-Emotional-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +