commit 0525c783daca527b396a891b94a84cc73d212c02 Author: ModelHub XC Date: Thu Jun 4 18:09:16 2026 +0800 初始化项目,由ModelHub XC社区提供模型 Model: anthonym21/dots.ocr-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ebeb502 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,38 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Dots.Ocr-1.8B-F16.gguf filter=lfs diff=lfs merge=lfs -text +Dots.Ocr-1.8B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +mmproj-Dots.Ocr-F16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Dots.Ocr-1.8B-F16.gguf b/Dots.Ocr-1.8B-F16.gguf new file mode 100644 index 0000000..8848108 --- /dev/null +++ b/Dots.Ocr-1.8B-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:240c5e89509d84e25c139caf512aa28677b8d0d7f00a54ce5029f075087ec236 +size 3560414496 diff --git a/Dots.Ocr-1.8B-Q8_0.gguf b/Dots.Ocr-1.8B-Q8_0.gguf new file mode 100644 index 0000000..306bd65 --- /dev/null +++ b/Dots.Ocr-1.8B-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff26644c550a9d51616e3aabafbcde2432812781e5c377ee13319e3486f6579c +size 1894530336 diff --git a/README.md b/README.md new file mode 100644 index 0000000..1399459 --- /dev/null +++ b/README.md @@ -0,0 +1,77 @@ +--- +license: mit +base_model: rednote-hilab/dots.ocr +tags: + - gguf + - ocr + - llama-cpp + - vision + - image-to-text +language: + - en + - zh + - multilingual +--- + +# dots.ocr GGUF + +GGUF conversions of [rednote-hilab/dots.ocr](https://huggingface.co/rednote-hilab/dots.ocr) for use with [llama.cpp](https://github.com/ggml-org/llama.cpp). + +## Files + +| File | Size | Description | +|---|---|---| +| Dots.Ocr-1.8B-Q8_0.gguf | 1.8 GB | Text model, 8-bit quantized | +| Dots.Ocr-1.8B-F16.gguf | 3.4 GB | Text model, float16 | +| mmproj-Dots.Ocr-F16.gguf | 2.4 GB | Vision encoder (mmproj), float16 | + +## Update + +On March 23, 2026, `mmproj-Dots.Ocr-F16.gguf` was regenerated from a corrected DotsOCR converter. The text GGUF files did not change. If you downloaded the `mmproj` earlier, refresh that file. + +Current llama.cpp fork with DotsOCR support and the compatibility fix: + +- [anthony-maio/llama.cpp](https://github.com/anthony-maio/llama.cpp) + +## Architecture + +dots.ocr = Qwen2 text backbone (1.7B params, 28 layers) + modified Qwen2-VL vision encoder (1.2B params, 42 layers). + +Key differences from Qwen2-VL: +- Text model is standard Qwen2 with 1D RoPE (not M-RoPE) +- Vision uses RMSNorm, SiLU gated MLP, Conv2D patches, no attention bias +- 2D M-RoPE internal to vision encoder only + +## Usage with llama.cpp + +Requires a llama.cpp build with DotsOCR support. At the moment, use: + +- [anthony-maio/llama.cpp](https://github.com/anthony-maio/llama.cpp) + +Single-image example on Windows: + +```powershell +llama-mtmd-cli.exe ` + -m .\Dots.Ocr-1.8B-Q8_0.gguf ` + --mmproj .\mmproj-Dots.Ocr-F16.gguf ` + --image .\page.png ` + -p "Extract all text from this image and preserve structure in markdown." ` + --ctx-size 131072 ` + -n 4096 ` + --temp 0 ` + --jinja +``` + +Equivalent server launch: + +```powershell +llama-server.exe ` + -m .\Dots.Ocr-1.8B-Q8_0.gguf ` + --mmproj .\mmproj-Dots.Ocr-F16.gguf ` + --port 8111 ` + --host 0.0.0.0 ` + --ctx-size 131072 ` + -n 4096 ` + --temp 0 ` + --jinja +``` diff --git a/mmproj-Dots.Ocr-F16.gguf b/mmproj-Dots.Ocr-F16.gguf new file mode 100644 index 0000000..5a5c134 --- /dev/null +++ b/mmproj-Dots.Ocr-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b65a1db58db75f6d1ae900a4cb80772c4c0fabfaf261439e4c4ab965f6970de8 +size 2524495808