commit e1a982a9035334026e16e3ba5b4d150ccb8c81e4 Author: ModelHub XC Date: Sat Apr 11 23:40:58 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/LFM2.5-1.2B-Base-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..9182d95 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/LFM2.5-1.2B-Base.i1-IQ1_M.gguf b/LFM2.5-1.2B-Base.i1-IQ1_M.gguf new file mode 100644 index 0000000..7b9dce9 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ab68aa7d75e4d30fa287b35ed437f606c56746b73cf989b4cbebb22b9a5dae83 +size 327144384 diff --git a/LFM2.5-1.2B-Base.i1-IQ1_S.gguf b/LFM2.5-1.2B-Base.i1-IQ1_S.gguf new file mode 100644 index 0000000..b64b960 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d4b26c0a5d3c29c4a9d11d0ee9e8c76dc91d2f26946b45f8f639c650b9f0fed +size 304387008 diff --git a/LFM2.5-1.2B-Base.i1-IQ2_M.gguf b/LFM2.5-1.2B-Base.i1-IQ2_M.gguf new file mode 100644 index 0000000..ed82446 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c005f48a7577d7f2488e8027060dd0db02392d1714b6dcdde5eaa0315ed6513 +size 434131904 diff --git a/LFM2.5-1.2B-Base.i1-IQ2_S.gguf b/LFM2.5-1.2B-Base.i1-IQ2_S.gguf new file mode 100644 index 0000000..67bc3ee --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f9dea4b913913b2cd0d5372e92335e18e379087f788a6ff45e23af598468e44f +size 403788736 diff --git a/LFM2.5-1.2B-Base.i1-IQ2_XS.gguf b/LFM2.5-1.2B-Base.i1-IQ2_XS.gguf new file mode 100644 index 0000000..b704f90 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:212f9c961ac63c5cfa351a4c6252590a439a1a4c4ddad48059a9f098f7d5aa06 +size 396202944 diff --git a/LFM2.5-1.2B-Base.i1-IQ2_XXS.gguf b/LFM2.5-1.2B-Base.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..901db18 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:41eb3d68f059e330617aadfe2e7a3c8df02c61fac6806a6e846af579742dd096 +size 365073344 diff --git a/LFM2.5-1.2B-Base.i1-IQ3_M.gguf b/LFM2.5-1.2B-Base.i1-IQ3_M.gguf new file mode 100644 index 0000000..268c9ad --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dc3db4f622ad0d260700e76f5cb442ac884b67812e35eeac8d01c6b61f741b60 +size 566793152 diff --git a/LFM2.5-1.2B-Base.i1-IQ3_S.gguf b/LFM2.5-1.2B-Base.i1-IQ3_S.gguf new file mode 100644 index 0000000..bd0583e --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d89a3391ec2f9f7316076f8242cdbfaf1fe422122e83c2078fd5877dc5ecb5ad +size 558158784 diff --git a/LFM2.5-1.2B-Base.i1-IQ3_XS.gguf b/LFM2.5-1.2B-Base.i1-IQ3_XS.gguf new file mode 100644 index 0000000..e426e34 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b9777b11614085a63b7a7311cc110d1afee74982a14e4b33557dfb6bd168f97 +size 537809856 diff --git a/LFM2.5-1.2B-Base.i1-IQ3_XXS.gguf b/LFM2.5-1.2B-Base.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..f43a18b --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff36d25485f60b5bd48f618c1eb5f78b2ea4ef8b3ca517b94bba4a9181dcf16f +size 490984384 diff --git a/LFM2.5-1.2B-Base.i1-IQ4_NL.gguf b/LFM2.5-1.2B-Base.i1-IQ4_NL.gguf new file mode 100644 index 0000000..3144d0e --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f64cee17cf113b4199eaddb720ce50134396072d345f422b24b052899762e051 +size 695751616 diff --git a/LFM2.5-1.2B-Base.i1-IQ4_XS.gguf b/LFM2.5-1.2B-Base.i1-IQ4_XS.gguf new file mode 100644 index 0000000..639de67 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09f3b79460560032b37e61bf0c62446a15590bddd67607ada49871a326eed755 +size 663376832 diff --git a/LFM2.5-1.2B-Base.i1-Q2_K.gguf b/LFM2.5-1.2B-Base.i1-Q2_K.gguf new file mode 100644 index 0000000..6b64f0c --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f65c184e35bf7fcc85e3aca02fc469ede7fed7686f6d8f7c8e3fa452c4317e4 +size 483398592 diff --git a/LFM2.5-1.2B-Base.i1-Q2_K_S.gguf b/LFM2.5-1.2B-Base.i1-Q2_K_S.gguf new file mode 100644 index 0000000..9becb89 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6355c545eaddd1a58717f9a203970df486b1a6ab995d008c73e3f66f8da315e2 +size 460805056 diff --git a/LFM2.5-1.2B-Base.i1-Q3_K_L.gguf b/LFM2.5-1.2B-Base.i1-Q3_K_L.gguf new file mode 100644 index 0000000..a9fdaac --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02334f7d33bc44a9b103305e524a988ecb27aec17cbced9b35453b0aef37800e +size 635474880 diff --git a/LFM2.5-1.2B-Base.i1-Q3_K_M.gguf b/LFM2.5-1.2B-Base.i1-Q3_K_M.gguf new file mode 100644 index 0000000..8de7b88 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a026ebcd53d5c1803c25543daebac373a4d492101d2a2cacccb01731dcffe597 +size 600347584 diff --git a/LFM2.5-1.2B-Base.i1-Q3_K_S.gguf b/LFM2.5-1.2B-Base.i1-Q3_K_S.gguf new file mode 100644 index 0000000..7afad64 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b3eb6a54f44328b1fb30ec3f3c3d3631e0a2a631903e4f66934c4d844136a8f +size 558158784 diff --git a/LFM2.5-1.2B-Base.i1-Q4_0.gguf b/LFM2.5-1.2B-Base.i1-Q4_0.gguf new file mode 100644 index 0000000..46c8906 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a3d60c684c96be991e87636a67738873d5831157a7358e458b08c5a9d3a76615 +size 697848768 diff --git a/LFM2.5-1.2B-Base.i1-Q4_1.gguf b/LFM2.5-1.2B-Base.i1-Q4_1.gguf new file mode 100644 index 0000000..670a231 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5be19d3e803a7896d84598ab6ad41d0587e0ab48a0913cb49ef757fff5ac03c7 +size 760501184 diff --git a/LFM2.5-1.2B-Base.i1-Q4_K_M.gguf b/LFM2.5-1.2B-Base.i1-Q4_K_M.gguf new file mode 100644 index 0000000..bba0b7e --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:046c02de246d5569d4252b264d5d7e7cae71bf034726298146d4be5762a4901b +size 730895296 diff --git a/LFM2.5-1.2B-Base.i1-Q4_K_S.gguf b/LFM2.5-1.2B-Base.i1-Q4_K_S.gguf new file mode 100644 index 0000000..2757b75 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e17d745af49e5657fd9de44365705169ce964981815cd734251aaed22031847f +size 700470208 diff --git a/LFM2.5-1.2B-Base.i1-Q5_K_M.gguf b/LFM2.5-1.2B-Base.i1-Q5_K_M.gguf new file mode 100644 index 0000000..d0c7ece --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f8d00ee9f3e50937256bc97d28a6a775bfa962f7b185d28630b22f81e0930539 +size 843355072 diff --git a/LFM2.5-1.2B-Base.i1-Q5_K_S.gguf b/LFM2.5-1.2B-Base.i1-Q5_K_S.gguf new file mode 100644 index 0000000..9080de1 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8123fd5107febf8b115878b95f5d14512f5e2d4279e956253a229fb30780abe1 +size 825250752 diff --git a/LFM2.5-1.2B-Base.i1-Q6_K.gguf b/LFM2.5-1.2B-Base.i1-Q6_K.gguf new file mode 100644 index 0000000..81ce131 --- /dev/null +++ b/LFM2.5-1.2B-Base.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6360286c32168fad03aa052f042f9926202bcc57f982b411a1af0ea53a2e69db +size 962843584 diff --git a/LFM2.5-1.2B-Base.imatrix.gguf b/LFM2.5-1.2B-Base.imatrix.gguf new file mode 100644 index 0000000..f23a20e --- /dev/null +++ b/LFM2.5-1.2B-Base.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0ff8cce2e9d5c445ad8f281f95c7e9fe60b8d990db27152e198e5f054b66fdad +size 1161536 diff --git a/README.md b/README.md new file mode 100644 index 0000000..99b1eff --- /dev/null +++ b/README.md @@ -0,0 +1,96 @@ +--- +base_model: LiquidAI/LFM2.5-1.2B-Base +language: +- en +- ar +- zh +- fr +- de +- ja +- ko +- es +library_name: transformers +license: other +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- liquid +- lfm2.5 +- edge +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/LiquidAI/LFM2.5-1.2B-Base + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LFM2.5-1.2B-Base-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-Base-i1-GGUF/resolve/main/LFM2.5-1.2B-Base.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +