mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-12 15:36:04 +08:00
commit 9b103e2fc1
26 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:901643160ecc714d112f345c4c7a786fc438d1bcf2405086e7d50504bbc39221
size 7959870592

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34f070ee857ec5bdc3be73fac1620bef5e8c5d77cc054edddcde402d3ca86931
size 7323843712

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34e110cc500c2366a6d50cef4bfb46532ecc3988c68a72ff88b39f3b8a1b7538
size 11362863232

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78dff9b2ccbc8739f313f33b4b5be88abef0dca8ee3fd921b28b94548f77e86f
size 10514827392

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5d1a301265d13f9ab07d96665e8d5340b363d3281ad281e8bb636964417a391
size 9951837312

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fc5bb286920c4ca0fbd962869964397e299a82c91cb8e9ffec91de1150ab451
size 9019915392

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22498ac474631935a1a8c5d23a7d5eadedcf4176804623059dd6ed88c3d2f81a
size 14930084992

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d579773dbf9efc48b576b9e526402dbe6dc986ae64c201d499529885f183fe2
size 14434305152

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:774ecd9e3df5ef279ac5b0dc7f2245b01a947dcfe689a90a7058a658c91f046c
size 13702923392

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:616c45069db8c9e54a0fa931910c63df5162bd5ba1c3ea4a3fdd5d135d73409d
size 12821039232

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12b75bbfbeb5ce148954f0e9583b9f77857d1730ca1cb8e9fb2db54bd1401972
size 17690497152

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94e0dc531603b1e269b236459c42abd0eff9e3b33aedc8da41eb9df9952ba79f
size 12344653952

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15f9bc57fc26be164fc8da48dd634a21fa7e5c1671d4cb53141c74e37893d88e
size 11465816192

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77001f076346462a92a715d2b3eb3591440786fd8e91b6fa263b923d19a211a5
size 17330996352

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd9510be5898767e56e566f0a685f5a9d5354a856955e65a34b13f591a76e975
size 15971779712

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1eed4c6e6f2b53dce1e012fb0bc7b94763fbdbf801c89e27e63f8b361ffc5ae4
size 14389740672

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ab023b566dc5ac4b352963d947c03ef3b970780acda0c00ad91b2c2496641c6
size 18703089792

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e158ab9ae583eda9e78f55dd232b0f26d85da7b0be59669d7b451471fca2cc8
size 20636524672

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46b7177dec540afd51ee04d314aee24a661dac3505363e0a2f421304f1297598
size 19762151552

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f5bc1cb9ca168c7c4745018d2bf14d278b0e65e8255e01939f600b06c799ee3
size 18771247232

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93cf90a77c57a8729f13037c97bd636c089cf75015f1fd4c0af9eeecfef789c3
size 23214833792

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec84a57a18337219bb294e081fb98c2e52dde54ecbf3492d9449cd920f6100d9
size 22635495552

3
Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53a04eec3773ffac5fb245448d011a54559eb2e1fd11cd249d941fc30f4ed3fa
size 26883308672

3
Qwen3-VL-32B-Thinking-abliterated-v1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:335d5037531631a4e1d025ee95a44e884bd818258bab5b455a347799db028216
size 15273216

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: prithivMLmods/Qwen3-VL-32B-Thinking-abliterated-v1
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- abliterated
- v1.0
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen3-VL-32B-Thinking-abliterated-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 8.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 11.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 19.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-32B-Thinking-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-32B-Thinking-abliterated-v1.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->