mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-17 09:29:09 +08:00
commit 9928317716
27 changed files with 254 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95df5c6a8bcabb0866e8d61a6fe8aee24c24f774de301a2fbdc5818063383733
size 3313733216

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a60c86e306c88221d0200d9b2994afa315f73187cc06bacfbd76809bd32512cd
size 3049971296

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef4e586bee76c449428462812afdff95aab1f19e682704669eb2f55243f489c3
size 4671493216

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:869ec33a2c06d36a7292d2046c8a8411a36d5dc7106d0a7b2f4a0c96a7f58197
size 4319810656

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45e70a18bdb16e1a8d8514650b327740032549e91a39a77faa0be2b53195aa35
size 4128611936

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bce2a5ec9bd548e1dd0b46fbe2e592d0123779249d18f8481e0bf8f1c2ddfd5
size 3753336416

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a28e67b29a68fd5b234f2e5754aeb106ab1a59c9df385e819fa9330d870f1e19
size 6113845856

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8c7e0d40f9336a1b7b4248f9d6bdbddd21efbc2c77a961d96ee840b9c01626b
size 5954040416

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66e349d1df25659bb8a8f963a0f66b0d79cba40037c3f60450917c15f463b4cb
size 5657653856

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8b064b5f7ecdee0c8d75dc488118e3022adc8759fc8c012d84a1ad1fe2147f8
size 5294863456

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76c55a8f99137b3cd87ef2848449e982db20456580961db0da673406cfd5062a
size 7683747936

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c73708dac103ec1f2ba9bbaae64c1513a439a3e396435076bbae8a490bbf8c0
size 7282309216

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a9c30c6857907ae89ce5255537a639125b17dfbaa25002b851a9562c945fa9a
size 5090258016

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be2a4e66e0e436d4af84929debb9d1bcfb62b6a2c346dcb20a0bd02c824ec963
size 4754426976

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97d524ae37976510f3259d53fec5ecfbc7538f2bd48df25b0ec294021e628f0a
size 7096824416

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:239ad13015c903eee3afe87f8322ffefa143d2e45d7cf411700b1a2949e2fbe1
size 6556152416

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0525959b97d37a05e4ceeac729980484b148cd60640f7ada78310e28c2d93c52
size 5928972896

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00a78d8fefb223ee515d34011f24880efc234c77b6f4dc6590262884ec26a9c5
size 7688171616

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76e186b13b2966dbad000df0707eaa6b3546dd9bb46abf6241c67c52faa7f841
size 8474828896

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be31eda4ad8a845d24a1fc8bfd74209adf7a75d97011dab7de40776218dcf8c0
size 8146759776

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7de9ef70967d9254da4a1a1c8928a367d90536789c93bfcb74d8c086c31a85eb
size 7717498976

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78913a4bb29cb4609811f601099d5a1703fa6fb82f4255a6eaaa43c143558835
size 9540178016

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd4616b8dbd96862d8527b3fcdd5599c537c1d2607c50d468d09699553fb0f64
size 9289502816

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:192c9bcfc7415120487ccfaf3446158b073f7b3c2814184263f077bb13095b2d
size 11020684896

3
Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1770644a2314c33b0a6278a580c34775cb53beff18954c278532fa399a4b7eb
size 12776032

119
README.md Normal file
View File

@@ -0,0 +1,119 @@
---
base_model: DavidAU/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B
datasets:
- DavidAU/TNG-in-house-datasets
- DavidAU/PKD-in-house-datasets
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- programming
- code generation
- code
- coding
- coder
- chat
- code
- chat
- brainstorm
- qwen
- qwen3
- qwencoder
- brainstorm 40x
- creative
- all uses cases
- Jan-V1
- horror
- science fiction
- fantasy
- Star Trek
- finetune
- Deckard
- PKD
- thinking
- reasoning
- unsloth
- 2x8B
- moe
- mixture of experts
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q2_K.gguf) | i1-Q2_K | 5.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_S.gguf) | i1-IQ3_S | 6.1 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ3_M.gguf) | i1-IQ3_M | 6.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_0.gguf) | i1-Q4_0 | 7.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q4_1.gguf) | i1-Q4_1 | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-i1-GGUF/resolve/main/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B.i1-Q6_K.gguf) | i1-Q6_K | 11.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->