mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-28 14:12:17 +08:00
commit e9aa6a0bff
26 changed files with 222 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb841141399fd3d5093097d5f8f8dbb854fa2c0fd223a82ff814f7ce72c8f2f4
size 7959870464

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee90c25acad0e5da57fc5d0ab0adbd577a3d89fcb5e05defbbdafa175a0b947e
size 7323843584

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:786b2b3a5a99d1b12958d85259e0d4cd957462cb760b078dfa637b484299c229
size 11362863104

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24b6b021b008d4e3514072bec8ca370596324832f72cd130861cc6f393fd3ec5
size 10514827264

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:076d2209f2eb4ec2a93560a4334bbef180a63f1f4993f1f3d6e512c1ab54f703
size 9951837184

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c815665528168ccd3bbea3b0194d3517ac548ab1e37f453974ffd963f2c17d3
size 9019915264

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c4b3cfc965740a87fc315380aaacdb8b3c6d0d3af60acb113cd3af4057d40e8
size 14930084864

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f3d57b8ef1b794dab49a930be97cfde6bdb63fa3b2c88c5ae5c781afbabe762
size 14434305024

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7da40fc50b0fa6296461ddd2ad71372de99357b307af3a459fae3800a732534
size 13702923264

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a3dba8cc5a4e6a85445a2836f734f6a659aece1d07e46c841c52a9514e76d2e
size 12821039104

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4056b922e99280c71ac6ad9dce6bc2af3e9d1f94fcc8126058a38e5633eec4c
size 17690497024

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:426f412df274f1fe2dd3841e9a43eabd91e58a94aae57c558e0388c82f9e56f6
size 12344653824

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1712525cc8825c3950a0143b7a53611fab45041f4d7a1ac5a6837d25404266b8
size 11465816064

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45867a0eadcbad902030dd43a876c6d47c68379dadceb3616eb6313d47d9105e
size 17330996224

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e39cd9ee92b750fa4a92fdfe2ebb58644257d664dc04a8600f56c22d969e041d
size 15971779584

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f22c75ab8940f8efb6652008ed63c491022b4240b8a6d4f36aeada6a5941a0e
size 14389740544

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a2199603e16462b167796f50371f85b5ebeb7599ab8ae16e9f815cb266e038f
size 18703089664

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba3d1b3725d322f71e922347aaf57cafa5e3d74b1bf5e659a5f2a8ff91d84bd8
size 20636524544

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ead9b29de09212c6fa0cad1fa1b62a2ead171840be81c1c5b9cdce848f4a6ca5
size 19762151424

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:360c932584a85dfa4536afd431cc592792420354c1562b1dfd8591aae1916c69
size 18771247104

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8cbddf6b3099e5f7dc6a309a215c03dd1670ab44c882e5037eccf906fdc46d0b
size 23214833664

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c116e4e2c70eca4910a502ce51439dfc46d1b43f4df67fec70ca1dfc3b9ac796
size 22635495424

3
Qwen3-VL-32B-Instruct-heretic-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35d8a5f2bd967e50f4a5411a866d308a08f53a6b22c294889cc6fb259bc3b7b2
size 26883308544

3
Qwen3-VL-32B-Instruct-heretic-v2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52cbc031a78ff6126a906fdfb6d306fb207da4b1b6691d01167aac461d7b9bdc
size 15273216

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: coder3101/Qwen3-VL-32B-Instruct-heretic-v2
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/coder3101/Qwen3-VL-32B-Instruct-heretic-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 8.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 11.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 19.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Instruct-heretic-v2-i1-GGUF/resolve/main/Qwen3-VL-32B-Instruct-heretic-v2.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->