mradermacher/InternVL3_5-14B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/InternVL3_5-14B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-13 20:17:22 +08:00
commit 57a2b39976
27 changed files with 228 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
InternVL3_5-14B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
InternVL3_5-14B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ecbb9ecac20c4bd71996a528cd6834b6f66dfc80f1d509c0ba37d2990adf2cc
size 3849653568

3
InternVL3_5-14B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9172fa781ef30fb036d2b022bd920f17be880d3c7246ea59cf65fe11d9b24824
size 3579931968

3
InternVL3_5-14B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4a3cf5e7f5c205b8043c81ff3a34eaddee7c45f499c897e75fffe39a7f8cd97
size 5322938688

3
InternVL3_5-14B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81d18d420ff564011e0fea953642bf38e6afce9f14149ed20b2f1c23ababbf72
size 4963309888

3
InternVL3_5-14B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7daf0edae67985b2f606075f510f093ed52c9e186bb673fe456a0f9618a0664a
size 4691586368

3
InternVL3_5-14B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b0c2f8390c37ff349cece0f5e863e54e8cea1e6b9a27d6d253df95eade7b652
size 4299189568

3
InternVL3_5-14B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4884fbddc07f2611d3d0019374fdb4cd55561aac0bbda081b6a6af20ade262d8
size 6883407168

3
InternVL3_5-14B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bd161b378e831d88d788f87ae042236aae406b53db04c8424c9676f74b6bb0c
size 6684955968

3
InternVL3_5-14B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57482704190ba527654fe8f6713befd2ea4c52ef0449ffe011ea5796d10c97f3
size 6375298368

3
InternVL3_5-14B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f249cd4c8822410a648b4e992484fc90427ad0eec8976ec9611ff282882e0bcb
size 5942663488

3
InternVL3_5-14B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f7aca036b178b06465d5a25e2e09a1baae5ef119bebacbd889ac0bfc59cad29
size 8541360448

3
InternVL3_5-14B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91119a2f95e7556cfee26e495d6c2f4308d538487952cb796f5d6c79668a03b5
size 8110727488

3
InternVL3_5-14B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90bede1f312b5d01ba539ab9aa71662e01f09b6187d1fb126d54ac9221e1b30e
size 5753981248

3
InternVL3_5-14B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0f2a770147b3946ffcaa30bfc7c34dd94a1f7d47e2627a6da84ce56d19a3d55
size 5389846848

3
InternVL3_5-14B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9d591e21ec2fadf7aaeca1aca185159317d29abb9c67f4fbeec801809e287a7
size 7900648768

3
InternVL3_5-14B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:288d4b7764f3b994147351a8d1412d566b25f84f597e91d765d3c83e4ce109d7
size 7321310528

3
InternVL3_5-14B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e03d292e730876e00984936d2942bc57d0c64b6a0b6157c72fcede8ec2e2737f
size 6657103168

3
InternVL3_5-14B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b840a2523410af6efebece4839c51491a03e7902fc954dda8377c30fb9885874
size 8542998848

3
InternVL3_5-14B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81b1461bea6b7c15c8457a478f4b2f38611b7abfeb4e08d4ee62604dff68a8ee
size 9389519168

3
InternVL3_5-14B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3e421fa28a0002da049425a75ce5d81655b914db5ef380f3aab8d7f75ef46d3
size 9001750848

3
InternVL3_5-14B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:650e09562817cf0dba92b5648185b29e08f4292c5b8538d5e941524ae59158ab
size 8573473088

3
InternVL3_5-14B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea8a3d6ac8c22bc504e7c6017d45b46c0cc5dc7fa516a1b8808f4fcc5c52f54f
size 10514567488

3
InternVL3_5-14B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c400e1d000bbe90f37a9a861a68de213e1963df4d3e43c8bcd24637a4f87ba12
size 10263892288

3
InternVL3_5-14B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9f2cfec8aac4bdcbc6487bd14ecb6c9861a4e25dda2d8b5858be18105b0e828
size 12121935168

3
InternVL3_5-14B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1edd9df54d6c07756242b4f023e26d2da77fc21e7d7bde10fe6b3fb6067672fa
size 7743552

93
README.md Normal file
View File

@@ -0,0 +1,93 @@
---
base_model: OpenGVLab/InternVL3_5-14B
datasets:
- OpenGVLab/MMPR-v1.2
- OpenGVLab/MMPR-Tiny
language:
- multilingual
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- internvl
- custom_code
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/OpenGVLab/InternVL3_5-14B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#InternVL3_5-14B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/InternVL3_5-14B-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/InternVL3_5-14B-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ2_M.gguf) | i1-IQ2_M | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/InternVL3_5-14B-i1-GGUF/resolve/main/InternVL3_5-14B.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->