commit 7657a809a3a247801881e1f72cb38f8a00e9e12d Author: ModelHub XC Date: Sun May 10 03:03:23 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/FlaffyTail-Reactive4B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..68a3f19 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +FlaffyTail-Reactive4B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/FlaffyTail-Reactive4B.i1-IQ1_M.gguf b/FlaffyTail-Reactive4B.i1-IQ1_M.gguf new file mode 100644 index 0000000..7829cc3 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40630550dfd2503cf9897c7a09f49c82095546fa9ecc7c03047b272d24434154 +size 1127017536 diff --git a/FlaffyTail-Reactive4B.i1-IQ1_S.gguf b/FlaffyTail-Reactive4B.i1-IQ1_S.gguf new file mode 100644 index 0000000..18a6c31 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d6b2b97eda1234dfdf9e0f97cf3a499eb6ef316840b789b0c995bf0b83d79fa7 +size 1055255616 diff --git a/FlaffyTail-Reactive4B.i1-IQ2_M.gguf b/FlaffyTail-Reactive4B.i1-IQ2_M.gguf new file mode 100644 index 0000000..0ce5538 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08904b14276807adcb2d2d6bcfdb1b10af5b542a95864e0466084969f013a17e +size 1512983616 diff --git a/FlaffyTail-Reactive4B.i1-IQ2_S.gguf b/FlaffyTail-Reactive4B.i1-IQ2_S.gguf new file mode 100644 index 0000000..1d3937d --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ba53cd27429ebab06ce6bf64783b7eded0c23fd864cdb1869e6ead05c4da979 +size 1417301056 diff --git a/FlaffyTail-Reactive4B.i1-IQ2_XS.gguf b/FlaffyTail-Reactive4B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..26f528a --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:18df6f9eb202fe1e7d7117fd214c8b03471a68503295f69d94e5f3ac0511e3f3 +size 1354099776 diff --git a/FlaffyTail-Reactive4B.i1-IQ2_XXS.gguf b/FlaffyTail-Reactive4B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..3182946 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0bed12a37b734a518baadd6a637a8778df791d1beac21ab434bb1c7fdcdd5e92 +size 1246620736 diff --git a/FlaffyTail-Reactive4B.i1-IQ3_M.gguf b/FlaffyTail-Reactive4B.i1-IQ3_M.gguf new file mode 100644 index 0000000..200ae52 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c36fe237a4e5f78bc12a8c644aabc4d5ee2293ae64096b5ebf848023f5766e26 +size 1962895936 diff --git a/FlaffyTail-Reactive4B.i1-IQ3_S.gguf b/FlaffyTail-Reactive4B.i1-IQ3_S.gguf new file mode 100644 index 0000000..77032ae --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8abf413b4af7dcac86fe89da9388187cec761783951f30a7810ff20f768f34c8 +size 1899530816 diff --git a/FlaffyTail-Reactive4B.i1-IQ3_XS.gguf b/FlaffyTail-Reactive4B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..457c657 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b27a541b89215fff6424b56de7ce999eef6687671771d95452c7306ae41e54b +size 1814374976 diff --git a/FlaffyTail-Reactive4B.i1-IQ3_XXS.gguf b/FlaffyTail-Reactive4B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..5993df8 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:264f0f5402c2f94f6d73e0ce093f199c6b9a29b0bdf4969be9b079d32ea07c42 +size 1670188096 diff --git a/FlaffyTail-Reactive4B.i1-IQ4_NL.gguf b/FlaffyTail-Reactive4B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..6696b31 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cab8be4a41de4976dbbad8ed6e6b9877a83222af5d531d193692b4dc7ed0bbf5 +size 2381343296 diff --git a/FlaffyTail-Reactive4B.i1-IQ4_XS.gguf b/FlaffyTail-Reactive4B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..be5c1d3 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b73f6d459cadc0352e0a433747c9ca40691eec30867d90f7e48889081b2b4c2 +size 2270751296 diff --git a/FlaffyTail-Reactive4B.i1-Q2_K.gguf b/FlaffyTail-Reactive4B.i1-Q2_K.gguf new file mode 100644 index 0000000..5497f58 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c0b4d53908c7eeecaf3071b85263d4f16aee62471ce050077cf7ec7c22bc1862 +size 1669499456 diff --git a/FlaffyTail-Reactive4B.i1-Q2_K_S.gguf b/FlaffyTail-Reactive4B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..2485c6b --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:648e2036a4a345dfb55fb1e53682446571336b37cbb8b435d899760d38dd0bd5 +size 1563454016 diff --git a/FlaffyTail-Reactive4B.i1-Q3_K_L.gguf b/FlaffyTail-Reactive4B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..cc5ae8a --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8b12f5b4f7383419d5439a17418011843cb45f9339e66336289fd0bfe04cc14b +size 2239785536 diff --git a/FlaffyTail-Reactive4B.i1-Q3_K_M.gguf b/FlaffyTail-Reactive4B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..828c695 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:614e75f1c37b51d41853b6ca6cb1c77e63af8a7010b99e1bf814d16029b75e95 +size 2075617856 diff --git a/FlaffyTail-Reactive4B.i1-Q3_K_S.gguf b/FlaffyTail-Reactive4B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..6a11203 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:992817287bc9c8cadad22e3e8de85fba479a578573e987d03de37ca8a6e0695c +size 1886997056 diff --git a/FlaffyTail-Reactive4B.i1-Q4_0.gguf b/FlaffyTail-Reactive4B.i1-Q4_0.gguf new file mode 100644 index 0000000..f5512f7 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4776218d466d41627b7fcb9467dfa486d9fab8c8f252ef87432a68d1cef5bfc +size 2375772736 diff --git a/FlaffyTail-Reactive4B.i1-Q4_1.gguf b/FlaffyTail-Reactive4B.i1-Q4_1.gguf new file mode 100644 index 0000000..614729f --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:15619339498301e1251b32986f9beb4768c178fe488cd58572c0ee736ac41b5f +size 2596629056 diff --git a/FlaffyTail-Reactive4B.i1-Q4_K_M.gguf b/FlaffyTail-Reactive4B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..a76cc42 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:79c8cda73911f0777095d0f272f0815c5422da63ccdde913b8a0084b38754471 +size 2497280576 diff --git a/FlaffyTail-Reactive4B.i1-Q4_K_S.gguf b/FlaffyTail-Reactive4B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..37c5f78 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00a2d196da1f3ed47d7050859f30eae5551cd4d7abd041b8c272fe0ec9aa2405 +size 2383309376 diff --git a/FlaffyTail-Reactive4B.i1-Q5_K_M.gguf b/FlaffyTail-Reactive4B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0aafcc4 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9142b558e601beb831f9cd129f758b2dc7c6549689829b2f5834808afdce7354 +size 2889513536 diff --git a/FlaffyTail-Reactive4B.i1-Q5_K_S.gguf b/FlaffyTail-Reactive4B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..4f3eafa --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d40e2fd672c9dc9791ef63c263199a731983fe9800d4573106f4c2b80fbd66b5 +size 2823711296 diff --git a/FlaffyTail-Reactive4B.i1-Q6_K.gguf b/FlaffyTail-Reactive4B.i1-Q6_K.gguf new file mode 100644 index 0000000..4025c80 --- /dev/null +++ b/FlaffyTail-Reactive4B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce93e11342554f0bf36fd69ed9c7fedcc4628287c50af7678d4edc8dda0896ca +size 3306261056 diff --git a/FlaffyTail-Reactive4B.imatrix.gguf b/FlaffyTail-Reactive4B.imatrix.gguf new file mode 100644 index 0000000..57e82aa --- /dev/null +++ b/FlaffyTail-Reactive4B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f1883d5b483fbc9f369a6b7fad7df1f320e06bc1d993934ca6524f07f6e2d35a +size 3872640 diff --git a/README.md b/README.md new file mode 100644 index 0000000..b36dbc3 --- /dev/null +++ b/README.md @@ -0,0 +1,98 @@ +--- +base_model: MarkProMaster229/FlaffyTail-Reactive4B +datasets: +- MarkProMaster229/FluffyTail +language: +- ru +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- furry +- person +- reactive +- conversational +- experimental +- russian +- roleplay +- qwen +- lora +- adaptive-behavior +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/MarkProMaster229/FlaffyTail-Reactive4B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#FlaffyTail-Reactive4B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/FlaffyTail-Reactive4B-i1-GGUF/resolve/main/FlaffyTail-Reactive4B.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +