commit b64ba9a20727b9c29556d6f026b45b8f10949b9f Author: ModelHub XC Date: Sat May 2 12:49:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..bbfba69 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Arabic-English-handwritten-OCR-v3.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ1_M.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ1_M.gguf new file mode 100644 index 0000000..36c122a --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e43499b55d15bd250c62196a79a4290ca054469e3e4b40208c44cfdc2f2df873 +size 850027200 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ1_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ1_S.gguf new file mode 100644 index 0000000..1d9ef00 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8e3575da93a1353ddc7a6364bb33911b7f2b89435e23056efcd7f09bcdf5155 +size 791093952 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ2_M.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ2_M.gguf new file mode 100644 index 0000000..daaf97f --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7fb082a8d5a45503cf78245b8085cdee3b1821f7b1d6e8c5beef03c73bd88f80 +size 1140515520 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ2_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ2_S.gguf new file mode 100644 index 0000000..b024a23 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37f803d0c42a412112e712df0a8b12776f0db39736cf25adad4d72083f55d6ea +size 1061937856 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ2_XS.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ2_XS.gguf new file mode 100644 index 0000000..5929288 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99c7d602110a1c1acad39517bd08d704745993d4f9c5dcdf745f49e35188c0a8 +size 1031545536 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ2_XXS.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..78fa199 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24ee4ced9580020fa04d19477023dbcdebf5e7e7968ba2848b3251e8272bdaad +size 948249280 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ3_M.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ3_M.gguf new file mode 100644 index 0000000..dffbde6 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:830fe6a40d1285fce35704aa3fdca882ea7dd0e7c47be40f578f3aefd5c6b691 +size 1488894656 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ3_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ3_S.gguf new file mode 100644 index 0000000..c86363f --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0bbd3dafb29011b7c7820c190cc204429d6545c778cadf08e2a213701612b5d5 +size 1456863936 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ3_XS.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ3_XS.gguf new file mode 100644 index 0000000..9413357 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c4086cd5f1e206f9775b394a72bacf99a75e92155ddda5c2319f42bed434676 +size 1391835840 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ3_XXS.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..457e321 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa086afe51a2327387e72eb858cb7f5bcd76fa2e935fd6d1d04da2a4346e05e1 +size 1282826944 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ4_NL.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ4_NL.gguf new file mode 100644 index 0000000..54a275b --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:21d609c50f2c3ca461ef7529315bf7bf26da030e77c9e341ee103457c9add3ec +size 1825209024 diff --git a/Arabic-English-handwritten-OCR-v3.i1-IQ4_XS.gguf b/Arabic-English-handwritten-OCR-v3.i1-IQ4_XS.gguf new file mode 100644 index 0000000..82153d6 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c75996f628f400d200367acfa73afac59eb027aaf7f0e75b0bcd36d11fa4ae1a +size 1739094720 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q2_K.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q2_K.gguf new file mode 100644 index 0000000..4668948 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b7f3882bd73d9e0ccbd838fe7f7f018680a19673f2bebb0cda3774bdf9a44d5 +size 1274755776 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q2_K_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q2_K_S.gguf new file mode 100644 index 0000000..784ee50 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed222fa56f1d39bf5b9525907c8dd7b7d466eb1d717648ed6fd9860c7c8a0810 +size 1198127808 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q3_K_L.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q3_K_L.gguf new file mode 100644 index 0000000..280aac0 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2653419a1fd3b8af5837fa31e27e19eeac3074e86fd0df732ad2dd8602afdfbc +size 1707391680 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q3_K_M.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q3_K_M.gguf new file mode 100644 index 0000000..57d6fb9 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:34ec86277987f7eadd09e017e886301598e62cd6e320794561e45dd01bd6277c +size 1590475456 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q3_K_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q3_K_S.gguf new file mode 100644 index 0000000..84f358b --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af581df726aef4360c07f0e3449608bb71e265fb96c6f0c77126a5599b80bf83 +size 1454357184 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q4_0.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q4_0.gguf new file mode 100644 index 0000000..1085afd --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:78e5431f1d4fd8cede3a09a7fd6a67ac399967f50fecb4b2f0a6b2a5d14ad014 +size 1828485824 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q4_1.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q4_1.gguf new file mode 100644 index 0000000..23c6fb9 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0459d0bb9d82c1d7c3124c495156fd84c3488d4de2fd33e51577cf3e0a8a2c8b +size 1996257984 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q4_K_M.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q4_K_M.gguf new file mode 100644 index 0000000..5c225e4 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f9cee063dc2f5291e2f6b1637c1ee4fa3888038d57fe764b413f62f27a3de64 +size 1929902784 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q4_K_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q4_K_S.gguf new file mode 100644 index 0000000..c38ccfa --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:511dc992fdb9a6d0d87e2e5b8036ce91265015fdb6a14b5ba888179e3dbddbb0 +size 1834384064 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q5_K_M.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q5_K_M.gguf new file mode 100644 index 0000000..384d148 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:134402fb48955c3b4019fa79b6beb206dc1ab074e4972733b45defe06d549a87 +size 2224814784 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q5_K_S.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q5_K_S.gguf new file mode 100644 index 0000000..1817498 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d51524096fb8641cf9d89d45ddba3160e6a7349b0a6904dc449207dbcce55d5f +size 2169666240 diff --git a/Arabic-English-handwritten-OCR-v3.i1-Q6_K.gguf b/Arabic-English-handwritten-OCR-v3.i1-Q6_K.gguf new file mode 100644 index 0000000..e5cd3a0 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:608cfa3f139965fdd8eb0070fe60bad704c1264802185f31a2bddd12553edb0d +size 2538158784 diff --git a/Arabic-English-handwritten-OCR-v3.imatrix.gguf b/Arabic-English-handwritten-OCR-v3.imatrix.gguf new file mode 100644 index 0000000..005d1d5 --- /dev/null +++ b/Arabic-English-handwritten-OCR-v3.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b8b2885b69e641b0d2fdb15406cb70394d523f8b8817f9672d2cdff9a764847 +size 3393408 diff --git a/README.md b/README.md new file mode 100644 index 0000000..9ada88b --- /dev/null +++ b/README.md @@ -0,0 +1,91 @@ +--- +base_model: sherif1313/Arabic-English-handwritten-OCR-v3 +datasets: +- aamijar/muharaf-public +- Omarkhaledok/muharaf-public-pages +language: +- ar +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/sherif1313/Arabic-English-handwritten-OCR-v3 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Arabic-English-handwritten-OCR-v3-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Arabic-English-handwritten-OCR-v3-i1-GGUF/resolve/main/Arabic-English-handwritten-OCR-v3.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +