mradermacher/RC-Qwen2VL-2b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/RC-Qwen2VL-2b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-14 02:46:03 +08:00
commit 552438b3db
27 changed files with 226 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RC-Qwen2VL-2b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
RC-Qwen2VL-2b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2eb2d74ad076b24a53aa06747f424b805a629076eb9a7e65997753ba67d1a29e
size 464460512

3
RC-Qwen2VL-2b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:443d09d15bc35bf4213f1688b8a7b85e43de576054befbd1eba247d27803f700
size 436526816

3
RC-Qwen2VL-2b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:734c85071dbb47d1c3a429b55254f084238f363325b9b0abec757c3bfe4f966b
size 601053920

3
RC-Qwen2VL-2b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91ec403320d857cacf027371bf68e4f27059e9eba3f98fbfab4dda323c6a9356
size 563808992

3
RC-Qwen2VL-2b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b5c46243dc4d8f29510c82b915c8e4ca2b4eb39866f8f645ce010af656b7665
size 550325984

3
RC-Qwen2VL-2b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed55ac91bc4690fefb627d4769f95263a9054256e203a8a391230459406b4223
size 511016672

3
RC-Qwen2VL-2b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca23a9a0e7337f887840d57b63d1edf49112111216586bd14619d09594ea44be
size 776663264

3
RC-Qwen2VL-2b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1efb07e7e8561193fe47b02786254044e074bc97dd1ad657dd84625119de8119
size 762406112

3
RC-Qwen2VL-2b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8348f2205009452cd4ea9995cf6fe873a7155205e820776282491606d42a0eb7
size 731698400

3
RC-Qwen2VL-2b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c01b25bc52f6d23dc893bbcb02c14d7d3e3ca8e6ead13e435c36c0a2114226b1
size 668791520

3
RC-Qwen2VL-2b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40cf70c0e76f3fc1aeb00a6467c6d953bbac98f9e27bb5babefc53c90c259bf1
size 936330464

3
RC-Qwen2VL-2b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d3deea1a8dd9a92b329545a4ea0806f14b4a48731f5898461c676997142cde8
size 895730912

3
RC-Qwen2VL-2b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d38bc6cda8bfefd86756d38db96dff9294fd5b04f091c06e4577e262006c151
size 676304096

3
RC-Qwen2VL-2b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4372af6019c92064865d631dc5bc301729cec73b01bcc2bf0f97dafa23148240
size 640134368

3
RC-Qwen2VL-2b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:504c6ea6b503429f90bcbf6073cf037e7ac380ac95755dde7873cfff6370d831
size 880162016

3
RC-Qwen2VL-2b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d90eee6558e3a88ebaee609a90ad3e10a84762b8a0d0b9f07eb71226f439d4c
size 824177888

3
RC-Qwen2VL-2b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c60a66ab7a6eed6cff204c561ec894b26030af5888d1f885764f1614b793ab3c
size 760943840

3
RC-Qwen2VL-2b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b07ff7cc75eaac1eefdfed9044f8699117153bd8cfbe505956f815063c88b49c
size 937534688

3
RC-Qwen2VL-2b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1283a87ecfdfbb156414e218d3a865dc6197183a3fe51c34777b0f1de1972f8
size 1016841440

3
RC-Qwen2VL-2b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42292e5029d3da74c5f8305afab8faeb0f05bf0d707c54d3772e4a08e791ece5
size 986047712

3
RC-Qwen2VL-2b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a85e2ef614156d86f584856bfb761b2273ad7ee75348f3ab52592ab7c54a5823
size 940311776

3
RC-Qwen2VL-2b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98c9be15d74da801106b94805756dc8d3ca4680770c49a6d86d6e042887b8c88
size 1125049568

3
RC-Qwen2VL-2b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a3d3f41c1ae91aa961f7f738a16825dc7c7aea73492c01f4aec8ab722b37504
size 1098728672

3
RC-Qwen2VL-2b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f942ae976f9a8c4986f972c0caccb44a67298bc71a20a69046dd47a40229a09e
size 1272739040

3
RC-Qwen2VL-2b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1ca69db0b244e5b697db68086fe46356fabc09dcb3f7a9a826b4a464671db35
size 2065888

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: weihongliang/RC-Qwen2VL-2b
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- multimodal
- llm
- personalized_multimodal_understanding
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/weihongliang/RC-Qwen2VL-2b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#RC-Qwen2VL-2b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/RC-Qwen2VL-2b-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/RC-Qwen2VL-2b-i1-GGUF/resolve/main/RC-Qwen2VL-2b.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->