commit 75530dcca04a61d1f1f374961ab7a6a64124cc1d Author: ModelHub XC Date: Sun Apr 12 00:00:02 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/LightOnOCR-2-1B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..d80e75c --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LightOnOCR-2-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/LightOnOCR-2-1B.i1-IQ1_M.gguf b/LightOnOCR-2-1B.i1-IQ1_M.gguf new file mode 100644 index 0000000..e19db8f --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc83f0b8ec533f945182f2c622a2abdbda7a5f803e463d36eaa1ab466ef5f5f9 +size 216049056 diff --git a/LightOnOCR-2-1B.i1-IQ1_S.gguf b/LightOnOCR-2-1B.i1-IQ1_S.gguf new file mode 100644 index 0000000..d08ca49 --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a6deb1eb2475545b390ac83fd5a9a7195ab586fef0beb89e205609643c4480ff +size 208012704 diff --git a/LightOnOCR-2-1B.i1-IQ2_M.gguf b/LightOnOCR-2-1B.i1-IQ2_M.gguf new file mode 100644 index 0000000..6835780 --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:81f733f09c8a1dbc99c5288311adfe704d6a979ffbb675a0253f10823abf361f +size 264906144 diff --git a/LightOnOCR-2-1B.i1-IQ2_S.gguf b/LightOnOCR-2-1B.i1-IQ2_S.gguf new file mode 100644 index 0000000..6bb9ce2 --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4226743b18b93e4017c4d922e05652b9105a30187c8c9c23f484c38d6020b23b +size 254191008 diff --git a/LightOnOCR-2-1B.i1-IQ2_XS.gguf b/LightOnOCR-2-1B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..6a1a3dd --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:192a9391c3e51081e43dfd9e4973976e86c73f061dbc146b7021cd7c556f0f61 +size 241993120 diff --git a/LightOnOCR-2-1B.i1-IQ2_XXS.gguf b/LightOnOCR-2-1B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..3394d16 --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:353621079a1d1ea1114bfe42833416c338a27dae69c7a8a9f31f242516923e32 +size 229442976 diff --git a/LightOnOCR-2-1B.i1-IQ3_M.gguf b/LightOnOCR-2-1B.i1-IQ3_M.gguf new file mode 100644 index 0000000..83bdd51 --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cacb761821e50bbd6850b4594a937fa87b4393db23a00ed0894ace33d2a5ba18 +size 336023968 diff --git a/LightOnOCR-2-1B.i1-IQ3_S.gguf b/LightOnOCR-2-1B.i1-IQ3_S.gguf new file mode 100644 index 0000000..c77883d --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:991057ab01dacce44bbcc27d06dffc2ac2278250ec9b2ddb69e05b66a05bc44e +size 323072416 diff --git a/LightOnOCR-2-1B.i1-IQ3_XS.gguf b/LightOnOCR-2-1B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..ac21edd --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:429824a724894adcafad79d16e025dcce08af8acadf0dd1ac37265f1ffe5b513 +size 312750496 diff --git a/LightOnOCR-2-1B.i1-IQ3_XXS.gguf b/LightOnOCR-2-1B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..23d5f7f --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a0675656a4730b5a3bd76e975005cde1420aceb879cf2a73299a8f867f91c85 +size 279012768 diff --git a/LightOnOCR-2-1B.i1-IQ4_NL.gguf b/LightOnOCR-2-1B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..dd17035 --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a5db9fcf32b89f97f3fd85329441f015d675cc7a448d2da7364b2d2e7c1bb294 +size 381563296 diff --git a/LightOnOCR-2-1B.i1-IQ4_XS.gguf b/LightOnOCR-2-1B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..3879dfc --- /dev/null +++ b/LightOnOCR-2-1B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8412e1bef80f5439284eb4f2988a718fa976ae1c7f5701530ed2e5ecaf9a8dec +size 367800736 diff --git a/LightOnOCR-2-1B.i1-Q2_K.gguf b/LightOnOCR-2-1B.i1-Q2_K.gguf new file mode 100644 index 0000000..f2a771c --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a37680fd86c5b21b2f305fe81e4fe7fe53b09234605ecf64ab846270571ba6c1 +size 296235424 diff --git a/LightOnOCR-2-1B.i1-Q2_K_S.gguf b/LightOnOCR-2-1B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..641d898 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56080d3122f6a45609542eb34157ee40c96de9ed06168de862038fe18fdd8ad6 +size 280555936 diff --git a/LightOnOCR-2-1B.i1-Q3_K_L.gguf b/LightOnOCR-2-1B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..894e7d3 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f38f969836d007399fe06fa472d488122fb3726a9a2f855afdeb6b2e2d248a1f +size 368488864 diff --git a/LightOnOCR-2-1B.i1-Q3_K_M.gguf b/LightOnOCR-2-1B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..0d9674a --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7f0aa6095ee8eadc8b6e589abed866604ea189f9e3e90d95c5c51f8f5d38680b +size 347124128 diff --git a/LightOnOCR-2-1B.i1-Q3_K_S.gguf b/LightOnOCR-2-1B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..4a45278 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb217ffa7e1d4b69da7f659810c908ad93dddb7cdf839de0661279e5b7f8ff8e +size 323072416 diff --git a/LightOnOCR-2-1B.i1-Q4_0.gguf b/LightOnOCR-2-1B.i1-Q4_0.gguf new file mode 100644 index 0000000..4d8e660 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b7d8003cbe59fcc1f374a9423ed5ebe236ed03e15f1e98057e7e1fde8ffb5d5b +size 382153120 diff --git a/LightOnOCR-2-1B.i1-Q4_1.gguf b/LightOnOCR-2-1B.i1-Q4_1.gguf new file mode 100644 index 0000000..54abdf5 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71c1ef62a1d770ff89b1c5ce205ac5fac668abdae196b34bb84c24d05f879de8 +size 409088416 diff --git a/LightOnOCR-2-1B.i1-Q4_K_M.gguf b/LightOnOCR-2-1B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..4e92cdb --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:168a7125e8c4213977cea87a7c633f541116fee9308874b8c27b654d75377b97 +size 396702112 diff --git a/LightOnOCR-2-1B.i1-Q4_K_S.gguf b/LightOnOCR-2-1B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..254f193 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6df293412e0d0c77b1114c3721e7ebdb4a5ea5a70d60b787926bae4b804a3eac +size 383267232 diff --git a/LightOnOCR-2-1B.i1-Q5_K_M.gguf b/LightOnOCR-2-1B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..982e557 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:19154487f9441a29c92a7fb4464c0cbf5108187d8fa8c99efd2caed76a286b2e +size 444412320 diff --git a/LightOnOCR-2-1B.i1-Q5_K_S.gguf b/LightOnOCR-2-1B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..8bdbf13 --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ebeb2c3c3e15488c9d7861f492319ec4e0459f78a7ead1ce402e804d42d6f6c8 +size 436613536 diff --git a/LightOnOCR-2-1B.i1-Q6_K.gguf b/LightOnOCR-2-1B.i1-Q6_K.gguf new file mode 100644 index 0000000..092b7ea --- /dev/null +++ b/LightOnOCR-2-1B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:579cdc0d3d5af6ed90c79912fd36b8f8994082c4e1d0cee50e8cb45eaf8228f3 +size 495104416 diff --git a/LightOnOCR-2-1B.imatrix.gguf b/LightOnOCR-2-1B.imatrix.gguf new file mode 100644 index 0000000..cd86f72 --- /dev/null +++ b/LightOnOCR-2-1B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a2ef63c3f13e23687456ee84570c57585eccadaf9b302b68cc62695d5061b18b +size 1177056 diff --git a/README.md b/README.md new file mode 100644 index 0000000..2c0b9f7 --- /dev/null +++ b/README.md @@ -0,0 +1,104 @@ +--- +base_model: lightonai/LightOnOCR-2-1B +language: +- en +- fr +- de +- es +- it +- nl +- pt +- sv +- da +- zh +- ja +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- ocr +- document-understanding +- vision-language +- pdf +- tables +- forms +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/lightonai/LightOnOCR-2-1B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LightOnOCR-2-1B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/LightOnOCR-2-1B-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/LightOnOCR-2-1B-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.4 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-2-1B-i1-GGUF/resolve/main/LightOnOCR-2-1B.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +