mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-28 01:56:17 +08:00
commit 606a275b37
27 changed files with 226 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-4B-abliterated-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae4208d065f896a45c2f813f7170bc49aa9c6ff011952623234394d45118fc3f
size 1127017056

3
Qwen3-4B-abliterated-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c5da7da83282ff9353b311d1472be034be925db07f9bc08912aa39c6a8efe5a
size 1055255136

3
Qwen3-4B-abliterated-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8337534a391a72a82133e0a7ae5326029f28249c51ded3abe2fe890136376c42
size 1512983136

3
Qwen3-4B-abliterated-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6176a56ef968df0e15822dbd18ea38db4e1a38bcf1e747630f10d790dea2384e
size 1417300576

3
Qwen3-4B-abliterated-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ff56c5f42583aa90206856f5624bd3fd63288747235c2da1626dfce72bd960e
size 1354099296

3
Qwen3-4B-abliterated-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c32deaddaa152342118c08d514098ebb5385e358d873e512f9e619365534b53
size 1246620256

3
Qwen3-4B-abliterated-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6dc9f23224897f1589d5ff8a3b2105641bf907a8d0f515a1b1f3cd4876192c8
size 1962895456

3
Qwen3-4B-abliterated-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a97d6782a37b3fe3a13eaf7729589c487c6ac778877927eae7602b94deb5e151
size 1899530336

3
Qwen3-4B-abliterated-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af18c7ae35868f9e656ca6c32cd235fb1509b9f44908d52b5ffcf94a0f5237ae
size 1814374496

3
Qwen3-4B-abliterated-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be7d105731d910fe636b2afd5949450f8af88f08ab4561667d1db3a2276bd7fc
size 1670187616

3
Qwen3-4B-abliterated-v2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:518639a159cb047b91a09f351bf874d9df01a2f8f52560b3dd41ebcc3ab5bab4
size 2381342816

3
Qwen3-4B-abliterated-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd5cb2adca3765388666a63f0804e77eac2f6f98e5f2004828052e014105fe04
size 2270750816

3
Qwen3-4B-abliterated-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ca2442e601dcac5450962edd48abf1c911813e34598ad3f14370f0b8215969e
size 1669498976

3
Qwen3-4B-abliterated-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc03289c816fc9a54b9ded33b1ade2997dc14d0439c713bf6fe55cd0438656f1
size 1563453536

3
Qwen3-4B-abliterated-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2f243c3aa365b00a1034922472c99f4f6ef322d6ef56629682c7ef6a82d2b22
size 2239785056

3
Qwen3-4B-abliterated-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4e9616044609f577e65671bdfaeb38b2aef390cc47d7b6b98d09410024507ee
size 2075617376

3
Qwen3-4B-abliterated-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:573db7b5e521efdb5cc2b8fba36113737eebe0b7c7e113e147de75385eb6cd45
size 1886996576

3
Qwen3-4B-abliterated-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64270919b475d9d7768ff9030eeac5ec24368470320122d9fc272e2a955eb123
size 2375772256

3
Qwen3-4B-abliterated-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b9cacead035405fea3cfd153c39edfae840af5eb8505dcd872ea225e4e8cd99
size 2596628576

3
Qwen3-4B-abliterated-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36cccbc33e72d09145c09654073783c2d1c09f52f91a2a43d63995183bbb165b
size 2497280096

3
Qwen3-4B-abliterated-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:511261b8ba8cce961d48142f92cde7aa69cef90120256a3dd7119dc1ba7cdc05
size 2383308896

3
Qwen3-4B-abliterated-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:646f6db4e62b20c44905a7894b55b0ff88ca68f5a6fd08678bc90b856cbbc51e
size 2889513056

3
Qwen3-4B-abliterated-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29f115eccf06f4294c1da6ff1a83733d37e551ae1baa0e5f1208057486ea1911
size 2823710816

3
Qwen3-4B-abliterated-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f54f60f795d69249fabd3b2b12efb2d250c7e718a1293190af418c81cc3707a
size 3306260576

3
Qwen3-4B-abliterated-v2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5af18695b11d8affc80ec959fdbc8da5caaa04c7565ad4d77ee91c27797eba1b
size 3872640

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: nitrox/Qwen3-4B-abliterated-v2
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- abliteration
- uncensored
- minimax
- moe
- int4
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/nitrox/Qwen3-4B-abliterated-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-4B-abliterated-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF/resolve/main/Qwen3-4B-abliterated-v2.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->