commit 4602ff39c09a78d38ff8e145c3aeb558e472d371 Author: ModelHub XC Date: Fri May 22 08:54:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..566c5db --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +PlayerAI-1.2B-v1.5.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/PlayerAI-1.2B-v1.5.i1-IQ1_M.gguf b/PlayerAI-1.2B-v1.5.i1-IQ1_M.gguf new file mode 100644 index 0000000..48e7c94 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bc7131c4c3650f3dc01c1b8691953904d2a2f0e75109d21240d1d617640f4a1c +size 327144992 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ1_S.gguf b/PlayerAI-1.2B-v1.5.i1-IQ1_S.gguf new file mode 100644 index 0000000..e1f2505 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aad04f2ab065fe6c9ff990a9e1b33e9bb71f6b3200f923b78408e48b8aa48018 +size 304387616 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ2_M.gguf b/PlayerAI-1.2B-v1.5.i1-IQ2_M.gguf new file mode 100644 index 0000000..056b760 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:373da7796dbacf1625ca7c75c8af13299715a49eb25f9407ac0dc5c360b67ac6 +size 434132512 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ2_S.gguf b/PlayerAI-1.2B-v1.5.i1-IQ2_S.gguf new file mode 100644 index 0000000..902d76e --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c0dbc419d7f904dac91beee65538ff3cbd654abc31492c096ce9ddb16adfec6 +size 403789344 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ2_XS.gguf b/PlayerAI-1.2B-v1.5.i1-IQ2_XS.gguf new file mode 100644 index 0000000..fb60a4c --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:13c34b47d10a1d83a14f3c31285cee505a532bf7a9e64842b2f9ead65041cc4f +size 396203552 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ2_XXS.gguf b/PlayerAI-1.2B-v1.5.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..aa13c30 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89b5091b4a6766c4e72eedb0e03a5226f711ef0fac54db2f06cc27ed2a66c3bb +size 365073952 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ3_M.gguf b/PlayerAI-1.2B-v1.5.i1-IQ3_M.gguf new file mode 100644 index 0000000..bd9f6d3 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f01bde0374351f81cca4daa91a97be1aa7eb89ee6579982ae6a4c172fca41c4 +size 566793760 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ3_S.gguf b/PlayerAI-1.2B-v1.5.i1-IQ3_S.gguf new file mode 100644 index 0000000..c57f6ab --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d93834854576873f582b83babee94836ee66e057adccfb5e8a86262d50ca5826 +size 558159392 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ3_XS.gguf b/PlayerAI-1.2B-v1.5.i1-IQ3_XS.gguf new file mode 100644 index 0000000..9be4f9a --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4efb49a85432e3f6bf4f6755e58c63ddfad01610684198ae0717b480f542ad01 +size 537810464 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ3_XXS.gguf b/PlayerAI-1.2B-v1.5.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..acae1d4 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ebd0b4f267d2a227800287b94d99bc09cbfdc934dc9f04e59c0d7e8ba4f76dc +size 490984992 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ4_NL.gguf b/PlayerAI-1.2B-v1.5.i1-IQ4_NL.gguf new file mode 100644 index 0000000..3fc5d5b --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:404567073151c95988f9dcdadb2c8745d76818b2a252a0c0a0fe3d1038ab7703 +size 695752224 diff --git a/PlayerAI-1.2B-v1.5.i1-IQ4_XS.gguf b/PlayerAI-1.2B-v1.5.i1-IQ4_XS.gguf new file mode 100644 index 0000000..3f11e92 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:31b4c233bb19fe91c0e2222dc5b85c1cf3aac3ed7bbd0d725f8b897ccdc9b61c +size 663377440 diff --git a/PlayerAI-1.2B-v1.5.i1-Q2_K.gguf b/PlayerAI-1.2B-v1.5.i1-Q2_K.gguf new file mode 100644 index 0000000..dca4378 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f936a0cf0dea3724d493ebb3c87cc1d4584372304c2c8d2f6fa00588a58e8fa5 +size 483399200 diff --git a/PlayerAI-1.2B-v1.5.i1-Q2_K_S.gguf b/PlayerAI-1.2B-v1.5.i1-Q2_K_S.gguf new file mode 100644 index 0000000..9be03be --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8dcc30726fe3d5b009b2c8d9cd954654f9569b70edb777638f9f53971c36f39c +size 460805664 diff --git a/PlayerAI-1.2B-v1.5.i1-Q3_K_L.gguf b/PlayerAI-1.2B-v1.5.i1-Q3_K_L.gguf new file mode 100644 index 0000000..df641e1 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b67ae338b796ff348fde1a804f793d46605158465b4e0b31846eb5b15297a25f +size 635475488 diff --git a/PlayerAI-1.2B-v1.5.i1-Q3_K_M.gguf b/PlayerAI-1.2B-v1.5.i1-Q3_K_M.gguf new file mode 100644 index 0000000..7caf2c9 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:021baf81fe8524b616c8893e41ee52e1bb3f04c8a7f43fca30b39bf16274a069 +size 600348192 diff --git a/PlayerAI-1.2B-v1.5.i1-Q3_K_S.gguf b/PlayerAI-1.2B-v1.5.i1-Q3_K_S.gguf new file mode 100644 index 0000000..7a2684d --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c98ff6c2587ed682c56d96c0924d0cbcc3b96e996c340ad305d6c6d2cefb8d10 +size 558159392 diff --git a/PlayerAI-1.2B-v1.5.i1-Q4_0.gguf b/PlayerAI-1.2B-v1.5.i1-Q4_0.gguf new file mode 100644 index 0000000..8ccf31c --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:891be14c4d52b54a2c7d5267ccb7d6f0728bb169777a5de2cac14bff3e50bedb +size 697849376 diff --git a/PlayerAI-1.2B-v1.5.i1-Q4_1.gguf b/PlayerAI-1.2B-v1.5.i1-Q4_1.gguf new file mode 100644 index 0000000..21bdd62 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ef615bfcdfd9722b87305c453bb84d6e63724de377f99a05c608af970070bc6c +size 760501792 diff --git a/PlayerAI-1.2B-v1.5.i1-Q4_K_M.gguf b/PlayerAI-1.2B-v1.5.i1-Q4_K_M.gguf new file mode 100644 index 0000000..8c00f28 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c431bcb653d41f53ba9db82b65db12edfeb3529f5cf36d277eefa0e3d3df0fa4 +size 730895904 diff --git a/PlayerAI-1.2B-v1.5.i1-Q4_K_S.gguf b/PlayerAI-1.2B-v1.5.i1-Q4_K_S.gguf new file mode 100644 index 0000000..2443946 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:834d9cb6c3e6a9039b705b51e82e64d343acd0946cb6858ef6ddf36afac6c2b2 +size 700470816 diff --git a/PlayerAI-1.2B-v1.5.i1-Q5_K_M.gguf b/PlayerAI-1.2B-v1.5.i1-Q5_K_M.gguf new file mode 100644 index 0000000..6b814b2 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d0808f22b151c1e33b6471c23f554fa2640850c2820d292159975ac4a5180028 +size 843355680 diff --git a/PlayerAI-1.2B-v1.5.i1-Q5_K_S.gguf b/PlayerAI-1.2B-v1.5.i1-Q5_K_S.gguf new file mode 100644 index 0000000..0b390c6 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4784c63b175284e6694cef6adf03908bffdbf0c1dee918e8a17710093a8a73b +size 825251360 diff --git a/PlayerAI-1.2B-v1.5.i1-Q6_K.gguf b/PlayerAI-1.2B-v1.5.i1-Q6_K.gguf new file mode 100644 index 0000000..22f33f8 --- /dev/null +++ b/PlayerAI-1.2B-v1.5.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b7b1db83c6b8eac216a01867faa8693b745a73edefb3fb6fc03529250961c59 +size 962844192 diff --git a/PlayerAI-1.2B-v1.5.imatrix.gguf b/PlayerAI-1.2B-v1.5.imatrix.gguf new file mode 100644 index 0000000..a34d58d --- /dev/null +++ b/PlayerAI-1.2B-v1.5.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2687fecd6dc607236a65c3553d0cfe213a1299c7429964da4c7ae7ba4ed30f52 +size 1161536 diff --git a/README.md b/README.md new file mode 100644 index 0000000..019f727 --- /dev/null +++ b/README.md @@ -0,0 +1,85 @@ +--- +base_model: YoussefElsafi/PlayerAI-1.2B-v1.5 +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/YoussefElsafi/PlayerAI-1.2B-v1.5 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#PlayerAI-1.2B-v1.5-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/PlayerAI-1.2B-v1.5-i1-GGUF/resolve/main/PlayerAI-1.2B-v1.5.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +