commit de3d99c24a0b40e2966973f65be576b1cf628634 Author: ModelHub XC Date: Sun Oct 18 08:24:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..e976c7f --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LFM2.5-1.2B-CLAUDE-THINKING.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_M.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_M.gguf new file mode 100644 index 0000000..303778d --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f43010caed1440678470b3362d7e53b927944a0099c7bc07022a752a5f7393ac +size 327145152 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_S.gguf new file mode 100644 index 0000000..7fb0014 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e9b9b2c8b5fac6487fb05c3034f3d71bba36e49818fece1326c0f674a141c49 +size 304387776 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_M.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_M.gguf new file mode 100644 index 0000000..441305c --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75b0cc03064394bd1d4716da869f18d015424e3048ba44b101185edb3bb02831 +size 434132672 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_S.gguf new file mode 100644 index 0000000..2442670 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:539302339600741728794f6106dbaf2e4486557b03fc09aafd4eddbead15ca27 +size 403789504 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XS.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XS.gguf new file mode 100644 index 0000000..02959b8 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:075fe2d9b3be5b43c4561c90637647f3992ed49993352044a2a7250bdc2bb76b +size 396203712 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XXS.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..b40c31f --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:55d033ee124bdbfd99084c36afb342f9da350903443fa274633b8a56b016c7dc +size 365074112 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_M.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_M.gguf new file mode 100644 index 0000000..3525511 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a83317b3b6865bcb9c93cde2516b4e2081caf4b3d15aca5070917d781c62857e +size 566793920 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_S.gguf new file mode 100644 index 0000000..7167352 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7775cb1b13c07d83468d6796bb7201eb0cd2bb0791a42cb1364a9f41c7180321 +size 558159552 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XS.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XS.gguf new file mode 100644 index 0000000..1a74431 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c886dbdc4d32fc07c8e7c92d25669bb8bf9c75d8620295e0316085bab85a2ab9 +size 537810624 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XXS.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..46d48ca --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:072b1d1a4c81dcd53be1098748efcc150c3c498b840d106e26f95b0aba022082 +size 490985152 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_NL.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_NL.gguf new file mode 100644 index 0000000..0cceb48 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d110a2c7606b61857245cf0cccdb5be7c5884d56aa7b761b6acd274f88522e22 +size 695752384 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_XS.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_XS.gguf new file mode 100644 index 0000000..d97949a --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c7960fce6f1542250a99e4aec5ed74eb1b0e1b1ec217c542f6c57f199b1aebb3 +size 663377600 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K.gguf new file mode 100644 index 0000000..b692a6b --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b52999156126107de92cf92b401bd194ce74d19f5d0c562f8b7a89e1207e5c64 +size 483399360 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K_S.gguf new file mode 100644 index 0000000..39fec5a --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:328142775d3f7bb575e2a3cc9ef38b8dad88f0c271f48492fa9c8a5bbe49b801 +size 460805824 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_L.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_L.gguf new file mode 100644 index 0000000..bb627ae --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c7283658a4b477a154fd0aec713a02a6b7c2f25356b216f43c99cc361b16fcc +size 635475648 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_M.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_M.gguf new file mode 100644 index 0000000..dbaceb1 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ab7408d9f51dc38e81ef290c1113dcb2ffe58ddcfc9db087fe1e789883e6ec06 +size 600348352 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_S.gguf new file mode 100644 index 0000000..9acbeb3 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a33b8c9c39d60d879da12be84e5deb41924353b323c1b5c4ad4e03cb6d0a2b0 +size 558159552 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_0.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_0.gguf new file mode 100644 index 0000000..0712159 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:63dad160640cf0bcd70cd63ca3077fea06f4e3f0c2b45cff1b4b545cab6377d5 +size 697849536 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_1.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_1.gguf new file mode 100644 index 0000000..2c35ebf --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3936fda5db52f42fc7d1985af55b02007db3ad7bbc03a5c439bcef1cede0ecb5 +size 760501952 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_M.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_M.gguf new file mode 100644 index 0000000..aaffb1d --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4699a0f995085a58e8a605a731bd35405287aa76e26a7fd72f6f52bf1ee5cd8 +size 730896064 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_S.gguf new file mode 100644 index 0000000..d451cf3 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0ab1ed8ae585a57c5636500bb7c621d2f66922d3804e4473651fee291ed66ea6 +size 700470976 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_M.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_M.gguf new file mode 100644 index 0000000..080d641 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c30313a3add870939da2eb54f59aa67446d80d71651b7ec7924b5d62567f2e20 +size 843355840 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_S.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3b9cbff --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85b7edf6f0b17899444a2cdea1408775b6d535b14190f8497cb98cf55c7f5163 +size 825251520 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q6_K.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q6_K.gguf new file mode 100644 index 0000000..08ef600 --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f77f8f269e329c446d647045217238b9e70dd5e741e85c01c5991a840aa3625 +size 962844352 diff --git a/LFM2.5-1.2B-CLAUDE-THINKING.imatrix.gguf b/LFM2.5-1.2B-CLAUDE-THINKING.imatrix.gguf new file mode 100644 index 0000000..3853e5d --- /dev/null +++ b/LFM2.5-1.2B-CLAUDE-THINKING.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d17207013cba4df00576f295d138c4768f5f77faf0fddf361b8b4d5a88c26905 +size 1161536 diff --git a/README.md b/README.md new file mode 100644 index 0000000..edbca18 --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +base_model: traderpedroso/LFM2.5-1.2B-CLAUDE-THINKING +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation-inference +- transformers +- unsloth +- lfm2 +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/traderpedroso/LFM2.5-1.2B-CLAUDE-THINKING + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-CLAUDE-THINKING-i1-GGUF/resolve/main/LFM2.5-1.2B-CLAUDE-THINKING.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +