commit 316679193a6b84b2fc13e1c77c47df04996cddb8 Author: ModelHub XC Date: Sun Sep 27 11:15:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..88ce9b4 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf new file mode 100644 index 0000000..173fabc --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4fab2988565069cc097f3e64610e37524ff3f87b5e4d2b5553c9b5bd2933cf7e +size 731572640 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf new file mode 100644 index 0000000..0890673 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:471d736d85b68bc4b0cb0a0d7a7fd18bd93f5921a7ac613a3e775fda65c6a0f4 +size 677038496 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf new file mode 100644 index 0000000..b1556bb --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:949a5ecf0b15025b487b77476b4d084b36fc669ee62a3be522acb55e3aee95ed +size 981215648 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf new file mode 100644 index 0000000..dab5d00 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b5bab3a09d8310810155730a99354ca609fec34e964ce293393196d8913b237 +size 908503456 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf new file mode 100644 index 0000000..6f382dc --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dffae3da9571cf9d8f11cfd5a59a733277c7203efda8dec61ee2e6241e619802 +size 896223648 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..24ccbac --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dee2001036dc0bf928e98bf10d63576d2a67539ecf28249e0d2d7215af29bcdd +size 822462880 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf new file mode 100644 index 0000000..423ae84 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:96c514bd09eb7192a39852e3b3836753933b9be663b72af11b78061f25d20db0 +size 1284868512 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf new file mode 100644 index 0000000..3389407 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:825199cd20b0b1834108533b2149f34cf3349e95246656945ef12dc47302610a +size 1270524320 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf new file mode 100644 index 0000000..3c0796f --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:093b7e76b41b294bc504dc5533b06f5059f912f72374fe6b14b64fc6730359f0 +size 1221077408 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..efa8ab9 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9ab2f9550ade0974732915e40b859af06d4b9357fff4767e63bf8977c4c7a828 +size 1120528800 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf new file mode 100644 index 0000000..da35ae7 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2cac0bb3626d31898654ce9ece7827e808fccc4ad0fc145d4e86676421dea3ef +size 1593895328 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf new file mode 100644 index 0000000..352b752 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20b3c674e9538079662be42e01c78987edc601d95e7831fbb966e2e7dd095e07 +size 1517808032 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf new file mode 100644 index 0000000..22601c7 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1c94f2be1d86f59880490b9d2a504c449bdcb546bbc05b6a851b1b2ee6f34c5 +size 1094592928 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf new file mode 100644 index 0000000..1f5175c --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7ab719640017b2381594a69a564db06a2b0de3d22de03a88538c140af2cd1a1c +size 1038723488 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf new file mode 100644 index 0000000..e37412f --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c57d645f5630efe2261674f8dd4ecd3f7a5b371272491c7e56574b2c42d6db5 +size 1451649440 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a6f3d68 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ad42ff5c251e2c2b53a5c6b04bf5b703f0d1ced6983aafa6cd56ad2ccb7ef56 +size 1366845856 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf new file mode 100644 index 0000000..e5a0ee6 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:42d0232757d15ce6f65f441e520e00c9ecb9dcd4c4c69efb7ea012884f721809 +size 1270524320 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf new file mode 100644 index 0000000..9df5f17 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:934b343232fa0dd5cac4604e65a267e66216993f79720a5f70135d5a7fb45f6d +size 1598024096 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf new file mode 100644 index 0000000..cf1a5d6 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0fc96675565eeef2cd9e6c6fce8d4a5d7b24c462ef48ec0ad65feca0c656c93a +size 1746069920 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf new file mode 100644 index 0000000..1dc885e --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b19710b15123a13e95b8ded0c8586a075c7e58d578fc33c935a863c0c27844e1 +size 1674455456 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf new file mode 100644 index 0000000..83cc146 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e18b129e8a8409436b01bd7796745aea59524dd059cd8213a7209aa8db19b094 +size 1602677152 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf new file mode 100644 index 0000000..eabc56b --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b87486a63a6b1c53a2ed6cb0647561446ec819ced926bcd7cdc2ccf631c3c55 +size 1939745184 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf new file mode 100644 index 0000000..f5f1b6f --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fec871ada33d88a43fc4d0ee5e9eb71fb8eb59d2ef944d03e7aba9b6eac4269c +size 1898244512 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf new file mode 100644 index 0000000..dea3e8e --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:10f55452bbc5e8e79efe1d9bc84b5bf424aea8f05a451307a0c73286af31a9e3 +size 2221615520 diff --git a/LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf b/LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf new file mode 100644 index 0000000..a8231e6 --- /dev/null +++ b/LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eec96bb21b7b3c6d020802d2b5377aa36fbd88e10db2d7a7b968621e75108f80 +size 2430848 diff --git a/README.md b/README.md new file mode 100644 index 0000000..01329c9 --- /dev/null +++ b/README.md @@ -0,0 +1,84 @@ +--- +base_model: Guilherme34/LFM2.5-2.6B-Abliterated-Advanced +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Guilherme34/LFM2.5-2.6B-Abliterated-Advanced + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf) | i1-Q4_1 | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +