mradermacher/LightOnOCR-1B-1025-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/LightOnOCR-1B-1025-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-17 01:09:15 +08:00
commit 2ffbba8459
27 changed files with 237 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LightOnOCR-1B-1025.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
LightOnOCR-1B-1025.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6008088afd6b300b45c45f41d444110e6f66d02e06c1dbc7922b5e9f54b2c6a
size 267099424

3
LightOnOCR-1B-1025.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1110bd1923571103a6ac316c60b16393d5ae9c46ba805b3801c1b3528df6b758
size 259063072

3
LightOnOCR-1B-1025.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19536ebcb666744261f085d8d3e535ef0dc175eb9a3fa9cca92befb7fe2396ea
size 331757856

3
LightOnOCR-1B-1025.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99c0ca5da6351b22ac502cb2595f62cb998fa8ca7cbf19574b26d902fe149622
size 321042720

3
LightOnOCR-1B-1025.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbe198a2225abc87810f573dffaa1bcf67fa6617b10505ea560a3d79611c8b94
size 293043488

3
LightOnOCR-1B-1025.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05d8bb0256c70eb9413125e2c3ba0a990747faa3eb168e98a72be5909a4e9abb
size 280493344

3
LightOnOCR-1B-1025.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa4cb7df09ed91f0911c0fbd073e8a3a63965c49e233d49739c93a37bc3bae1c
size 402875680

3
LightOnOCR-1B-1025.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5353018220a1742284876158efc073735ba48aea5be11d71951b8d686c791604
size 389924128

3
LightOnOCR-1B-1025.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1122b7645416b4265722f056839e7bffb24121dd2f8de7b53ae27be3b48ee2cd
size 379602208

3
LightOnOCR-1B-1025.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27e0848964e6240da7f97405d84f233c7647ea5a2edb8a2e076ae485fd07a283
size 345864480

3
LightOnOCR-1B-1025.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf00d255aabafec91b40ef6ad0aac3aecee53242339bc90b7144894d3cb72fd4
size 469078304

3
LightOnOCR-1B-1025.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe76b272edb7b52f91373fff49aa930e7bc28a4bcfb134cad97206ad80b34a08
size 450453792

3
LightOnOCR-1B-1025.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44f009547278c6591248bfab51705bfad851335fff891df1390cd5bc465b5377
size 347285792

3
LightOnOCR-1B-1025.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c0838d8316be1296dd804d589fb5c72672cd32bce011e279b715ea901cb687c
size 331606304

3
LightOnOCR-1B-1025.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76198b9582fcf22eee5205009bf7c8bb9daa261a4076059442055af2a2a37363
size 435340576

3
LightOnOCR-1B-1025.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e644cb9075a4d91b0a8c12129f55f6ac0e688a1480010e5e6235557b2388f101
size 413975840

3
LightOnOCR-1B-1025.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e278d9e80f0332dd05c61682a414787a13e5d7602a86727d290b641eac70da1
size 389924128

3
LightOnOCR-1B-1025.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dff0b0f160c9af6880f3fe5b5378d0a8aa356e41181d905249783e2ce6c750c5
size 469668128

3
LightOnOCR-1B-1025.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c83258957640a581ae53bdd95fe26f38d2a6181ac416b2befa8422aa4f59cd6
size 506327328

3
LightOnOCR-1B-1025.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ae7d73298e8720bd53bfb64eaab7be98dd68d1e6682fabae8091d3e556db05c
size 484217120

3
LightOnOCR-1B-1025.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e40a392952487bbeb879c7786ede5fb352f2953a74cb4f0504d8c3372068dc7b
size 470782240

3
LightOnOCR-1B-1025.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2832d33c4f111307475832ba8b637c81cfc1bc73229531cb21b921494d881f0e
size 551375136

3
LightOnOCR-1B-1025.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cfc8f59faf98f1ef07103049ebc50c10438deeba3cedcd44e512c8b79c752230
size 543576352

3
LightOnOCR-1B-1025.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:882c24356e65cd2bcda5259f8c47a30722c17e0641c26f6e9017eee318fd5410
size 622730528

3
LightOnOCR-1B-1025.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d10ee3785ea843dc35c4644b35e7f204d1d7838416b01f2e9dc8f72591facdc2
size 1177056

102
README.md Normal file
View File

@@ -0,0 +1,102 @@
---
base_model: lightonai/LightOnOCR-1B-1025
language:
- en
- fr
- de
- es
- it
- nl
- pt
- sv
- da
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- ocr
- document-understanding
- vision-language
- pdf
- tables
- forms
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/lightonai/LightOnOCR-1B-1025
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LightOnOCR-1B-1025-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/LightOnOCR-1B-1025-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ3_S.gguf) | i1-IQ3_S | 0.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ3_M.gguf) | i1-IQ3_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q4_0.gguf) | i1-Q4_0 | 0.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q4_1.gguf) | i1-Q4_1 | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/LightOnOCR-1B-1025-i1-GGUF/resolve/main/LightOnOCR-1B-1025.i1-Q6_K.gguf) | i1-Q6_K | 0.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->