mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-23 18:59:10 +08:00
commit 77109e2dbf
27 changed files with 255 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34db28e3eae08f9c46345bece3a04f5749661c41a898e0a25f3de6231a6b8903
size 1735635328

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d0bd457ded472e87121e467bc1ddda71448686f66c4b8eaffd81f26355f1996
size 1588179328

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61e24a5f75bbe2f3db405d6592a8c1ae0c7f6ab201e24127a1ae7c5f9e3a6a49
size 2417799552

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dbdedd1843692b39544322e515061de27a73c9bb4a356ff8c07da42569c32a0
size 2221191552

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac1bd102b271496a5c4b9378ef5a52512dddacf3373e7c2fe779b7d8fe376c2f
size 2181673344

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e192914f3c1e809bcc5b13dfc33887feb5ae658ca6bfadccd69895efef50dfa
size 1981395328

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b46d840e8171e7bfb95f5b2b36f405aa5cc7a70b3a54d5493531cf67783e601
size 3192932736

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a1c13e9788b0ad4b63d7a0192f07cf3a8bbd9e1b078544d1d70abd9ac183d6c
size 3139455360

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e2bd6a244b14dcc18048e7077a54adafdfaf1a3945bfc7567e203c6650bc6c7
size 2982562176

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a51644d686a5a7eeac80d755dfb860ce9afd78e527af964a7c9470894058fb4
size 2778837376

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d031de9ed88d52cdb9eb07943c094961bd6446502bb532064b39479542317ed1
size 4028516736

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de816698ec6fc4d16926781cf9bbb941e31a46ba662b9cc76c229db1a200e754
size 3819325824

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:061c1ecf188eb1f691a765ccace6338704c4de9e86510d7b26b14e4f03570f32
size 2692172160

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c9a394a87e91826b83fb104ef2959c49ae1543c53ea9ec9b6f56193b1bd75bd
size 2512669056

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:600ded6dfd4d346fc3b04d984361ada4777fa05959fae705ab0457192964222c
size 3729869184

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd8487a4328649f52f8d57f854198359ebb55c223fc03138851042b1b099fb3f
size 3453569408

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:beaa6d2f659be1b7baa5be2631688171eebb67fe0c466d3260bef59cc9df3802
size 3139455360

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41f0c4bdb2ce48436d1f62fabcae8029d31e047d1c2775bc761091afec860a39
size 4042672512

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e50daee6d85e28c20a5cdbd4d377fb50d4d1a23ce139c4214fa1c925162d6f2
size 4446898560

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:744140e0d8bc7c498b4d1120719be3515ea0e21ce0b11b3cf760967c307192f8
size 4308584832

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4219731c0a65821bdfed58abb50c67cb0e4e77833adb957ca1dbe45c574e0879
size 4057876864

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48905adfac651a5382bad2c88cf977dcf6ea0a7eabca05a8f8a3ef83e8fc34cd
size 5009557888

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cae5060e7a87b72d0878279134eba088d648df12a73552e5f9cd91a3deafce5a
size 4865280384

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:974f506034ae4e33b13546040a5c02e24da324cd73d4ce864e1d00b6df3437a4
size 5754341760

3
Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:babf182272069c5ebad7fdb572c7a0c96dd5b48261810c13d1f8eddd09546783
size 8065056

120
README.md Normal file
View File

@@ -0,0 +1,120 @@
---
base_model: DavidAU/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored
language:
- en
- fr
- zh
- de
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- programming
- code generation
- code
- codeqwen
- programming
- code generation
- code
- codeqwen
- moe
- coding
- coder
- qwen2
- chat
- qwen
- qwen-coder
- chat
- qwen
- qwen-coder
- moe
- mixture of experts
- 6 experts
- 2 active experts
- 40k context
- qwen3
- finetune
- qwen3_moe
- creative
- all use cases
- roleplay
- merge
- not-for-all-audiences
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ1_M.gguf) | i1-IQ1_M | 1.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_S.gguf) | i1-IQ2_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ2_M.gguf) | i1-IQ2_M | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_S.gguf) | i1-IQ3_S | 3.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ3_M.gguf) | i1-IQ3_M | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_0.gguf) | i1-Q4_0 | 4.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q4_1.gguf) | i1-Q4_1 | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored-i1-GGUF/resolve/main/Qwen3-MOE-6x1.7B-10.2B-Shining-Madness-Uncensored.i1-Q6_K.gguf) | i1-Q6_K | 5.9 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->