mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-28 15:42:33 +08:00
commit ef1ed68bf4
27 changed files with 254 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce701074cdd701eb884c6f476bc6be956b402df41cce3369a98ff29a428c4ee5
size 450952384

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a61ebdb1a7119e08d1b46835c663e2c485936c46ec12b7f72699afafbe148c17
size 425000128

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19251a438611a9fe5d4a488d024725ab70b09ec111566fd61b2369bfbac658a3
size 593139904

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03dd1e4f16f968f824d494cd8ec4fc054439a91bfb6e942a4b0e3f5315a2c0ee
size 558536896

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ac7c7bf34f99d0bf7f402b194c5457d061901e3ade18a1ad72ed62b2351abaf
size 530644160

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d12309d70badb405ba9eea9883913babc6bccfe0f6f7b5577b7bd7dc4d4d02d
size 494206144

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29508fcaf450fb36fd1e1b8abcd96a6ecbc55babe2839fbb24e62dafa17ff157
size 747726016

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e6258ea3b285840794d0031a71cf7ccddebbb4b888e90c095832e3473af6d82
size 731014336

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b76cd1dc1dae5e67ee85334f274a4838f2585721e966484921399cb285c15870
size 702112960

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7856683b8d1deb779df0d9ff7a39815d58b3bf1bfdd53b1034d2c8442304f3bb
size 649795776

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7606ce0bc4c9153460e2dbc029099176f58cb6e38eb70217bf7635414f65360
size 915452096

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92e4656a1909540b7d1487a113fc0606ec31082ed02b77fcf402c6ddd9137858
size 872054976

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52d5ddcce0d673bbeb87571f68ad6fed13ff22d92a1516cee9bfa1ae4bb59326
size 634702016

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:819ce4a1d6fd70c0d924a60a4223b7fd41dfced4b4043d529f227543d7c86d53
size 598821056

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1ace2e3ab97772b7c26450c35688206c751ea42270abfb6b516bbe3ba8c5e6c
size 844555456

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:718f8eceed07f6807d26aab6d5e86a80600a22f78235d9cc2f260a4d7d4a16e7
size 791340224

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6aed28bfdbb234872258353ed40bf76036e5427f6204369e1329ebf10d1b62e0
size 731014336

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d5d2f47c7c424ebff0fc4e4a796a8bfb4dc18b3e6d50a1fe442ca03ad9a6f82
size 917811392

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:938fc8829a9e8da339ee127d25167ca8b697784cf156ae13d4f99f8c24daf3ab
size 1002246336

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2215a6a75e4330316c7f591f0149189ca4d5ffcf2f0bd6109c8228c73460616
size 964653248

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7e28504161cc635cbd276fb67a0155824b69829ff6ed17a97274e27386a0676
size 920694976

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58e07259cdbaaf50499395fa116f26069b208a774d4a377fb996ac7d0f8e30b4
size 1114386624

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ed9fbe2cdf7de089e1c2ac6ff9fee93aa17621ea9f3a31425742203cefd5713
size 1089040576

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17786c355b8c842432a28c087ef7ec73aea91c8ba3cecad492033ceaa31dec09
size 1273478336

3
Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae9763c4c1ef4376a052def0b529a43df606493a88f8ff15a9ffce0780e2a631
size 3018784

119
README.md Normal file
View File

@@ -0,0 +1,119 @@
---
base_model: DavidAU/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1
language:
- en
- fr
- zh
- de
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- programming
- code generation
- code
- codeqwen
- programming
- code generation
- code
- codeqwen
- moe
- coding
- coder
- qwen2
- chat
- qwen
- qwen-coder
- chat
- qwen
- qwen-coder
- moe
- mixture of experts
- 4 experts
- 2 active experts
- 40k context
- qwen3
- finetune
- qwen3_moe
- creative
- all use cases
- roleplay
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q2_K.gguf) | i1-Q2_K | 0.7 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.7 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1-i1-GGUF/resolve/main/Qwen3-MOE-4x0.6B-2.4B-Writing-Thunder-V1.1.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->