mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-30 20:30:45 +08:00
commit 916515d3fd
27 changed files with 232 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Uni-MuMER-Qwen3-VL-2B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: phxember/Uni-MuMER-Qwen3-VL-2B
datasets:
- phxember/Uni-MuMER-Data
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- uni-mumer
- hmer
- math-ocr
- handwritten-math
- latex
- qwen3-vl
- vision-language
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/phxember/Uni-MuMER-Qwen3-VL-2B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Uni-MuMER-Qwen3-VL-2B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Uni-MuMER-Qwen3-VL-2B-i1-GGUF/resolve/main/Uni-MuMER-Qwen3-VL-2B.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b009cbf160a1df20fbe33eb3d2c85950031350019ebc80a19d860026d454451
size 543795648

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4706158f275c46dd67c5cb2ef2047ed51dbaeac3f1a8ac9f09a7d4b50b187dbd
size 515779008

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:644b0cf422b734d5d0a249ecf6a77d4f38df771c4a87a4291567e1f3c5154d18
size 695183808

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:255368c5c7d563bc5c0738bd3493355e3eccc628e2203d7724b64246f56c953a
size 657828288

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65a3564c34e284b99f77436d66824ba01da1e86421a23d5f88be9be3149e1708
size 631515584

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95e7a5531db766d775c218686f5a42b210ac5b9904aad14192bfb9516ef0fca9
size 590490048

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bd52ea2cab10b53766707aead2c421d8337d2d5a6296a48712c7cceca424af0
size 895664576

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0562582ab9d6c2562287a303db53d517fa0fe534dffc1b99f57e1986de6b7f7e
size 867254720

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ef5c3df5949a64a9198a0a89da592655dcc2c215dd5865e34f47bf6769b1da9
size 834224576

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e201503ab1c90376bcc4e4a6daf3d63aff858b59e22692348a0511d4e8c1ed9
size 754362816

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40725b126c12a6475c6ac17c5468068f3c918ccb1784296d2e99ff21274c934e
size 1054425536

3
Uni-MuMER-Qwen3-VL-2B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e22710117c6971cab740e4abf9a3579cb3486a42226ce10025c6377409a5b7d
size 1010385344

3
Uni-MuMER-Qwen3-VL-2B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a9765d6263072ce74faeda2ed35a8387c23bbf2196b5e992044eed1d20cad06
size 777798080

3
Uni-MuMER-Qwen3-VL-2B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:538e036e6ae0b8ea831a4b3578699a6caab29036bcdae72db9e87d34c6019a1d
size 732971456

3
Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39aaa91984adc7572d0613860549ed8c09a1a1a423899584e1d926a57da47342
size 1003504064

3
Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c189bc81bc92449dac631e955e9f4f6440941a7acc2efe3d1807c190a043cf92
size 939540928

3
Uni-MuMER-Qwen3-VL-2B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4161ed53d44147a60a050d6c5026616c6132c433d32f5865a86eefcc96ecb453
size 867254720

3
Uni-MuMER-Qwen3-VL-2B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:020a1da50ee714c80775be475b57d65da9109e4ec0fd5ee4b2d0c70ce946e759
size 1056784832

3
Uni-MuMER-Qwen3-VL-2B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3502369d065ccdd6ecdc83072224da00a9ecf6dfdcdce997595cb8882bc30710
size 1142505920

3
Uni-MuMER-Qwen3-VL-2B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d68146d43345616b95090cea8730e9ed2ca2f5de7ab35945ea7a6f1d9c5851f
size 1107411392

3
Uni-MuMER-Qwen3-VL-2B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f11651a737206b98f1dff4b988d184a138cf9cf0fdccee7651eb9a5c284154e
size 1060192704

3
Uni-MuMER-Qwen3-VL-2B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:021142bcb7c50c435d86ad59a278d3b86894e9124f3986ca0113c2b68e9f9a4b
size 1257882048

3
Uni-MuMER-Qwen3-VL-2B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4d6f9ec5d7984c834b7f94777efe11d6a50d15108f6409414cde1e0d049229a
size 1230586304

3
Uni-MuMER-Qwen3-VL-2B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76cb4f8e547d7e737887e66ed7db8ac7a56aef9672dee92b1ccd43465e3559fb
size 1417757120

3
Uni-MuMER-Qwen3-VL-2B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6776c7e0b0040f80991b0a1ed8c80a3ec4ef8673545a45070ceb6b40b8452ffa
size 2094560