初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_M.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:476c0fc619f86d372c7f774f9ca854cef1ff8d0dac0a7ffc2825a6fd244e1a07
|
||||||
|
size 671019392
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8f7dc38ca253bb868802dde8852d9c2b4f2cc25bc3292aca2753a78abf60007d
|
||||||
|
size 621867392
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_M.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f96187b7fe0053556886b9a4fd1b7d45cfa12e5e40baa85dabfa927608062215
|
||||||
|
size 891679104
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7a7a4fd0b7d8f96b9253aeb9abda25076d95ad893b917a2589d23be0b7b98da4
|
||||||
|
size 826143104
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XS.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3c9d68b96343e1e1eb24cec1f4f4daa59190f407ea8cd5665be063b0435cf8d3
|
||||||
|
size 818475392
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XXS.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e2582588b09db7cd16d8b167d2f5f2975f7fca544748a9e4f6d18d803b5eb28d
|
||||||
|
size 752939392
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_M.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:48b793a10080736db322d0172a88398e670e4189fc92115a43965e8411e314c8
|
||||||
|
size 1217871232
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0c70c9b11d0f977b84f15c7550022383993c6b8e7c8a52aa89566422252a3bde
|
||||||
|
size 1171078528
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XS.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:267301776a77536c30f31cb496c2de9be7dca5bd618a32598c6358dc663ef9a9
|
||||||
|
size 1118780800
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XXS.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d62c951f240bee6fb169f37caddd298e404f055aa05793b9817634026f5d4447
|
||||||
|
size 1044902272
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_NL.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6742e233e4e32aab50ad29847f8dabdf4414a66a4621a798cdaa3267fdb61a86
|
||||||
|
size 1459633536
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_XS.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4c9a23c95ae6d9ae1658e0a33730b009aef8e1d05697d784ab7f81e52bd652a7
|
||||||
|
size 1391738240
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4bebbdf9520882c2ba13e64681571d28abe2e1b7c352cbe55fbe6a63d75e9006
|
||||||
|
size 1021984128
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1e23434204f8be687fae606607f0c5c147436534e0ac9742b030f7fbdb59e1f1
|
||||||
|
size 947010944
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_L.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fc56faa1301f459853dae6b30d755138923ce000d5a9d533e7f38eed84f3b43d
|
||||||
|
size 1337605504
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_M.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:689f35c51e8e085a5b870a324b1d7b9f5ed64d0342d5bcca6bf7a806bd72491a
|
||||||
|
size 1267809664
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8a395f3dc8a79f6adaccdc56311aa436cff40a732f89b37faba63cec00bb6df7
|
||||||
|
size 1171078528
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_0.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:44e26bf4da9c826a359a790463aadbedc1a2b11c1e7123845aa4f6774cf73760
|
||||||
|
size 1457012096
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_1.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:80853cba5ca4c2c0ea9981b2ed272679a22adf9efeca091383e89ae58185509b
|
||||||
|
size 1591754112
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_M.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d28e20d5743692788a52aab2399097d51edd4f2c2767771760d89b4dbab2a033
|
||||||
|
size 1550466432
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4cc411d066ff9ae199a14dd94849ffbd36a79caaba391d0ecbf870957453eb1a
|
||||||
|
size 1469070720
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_M.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:08922b73bacfb1927a0286caf8f806216cb833eddf8c1640d71c211c73beb35c
|
||||||
|
size 1778007424
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_S.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cc8a29d2228ec5504b025cb62990ad5b98e9c48577cd7d7050ede12a5e3e842d
|
||||||
|
size 1731214720
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q6_K.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8571bc40901914408ebd7f600d77f0e2a43f4d9843e097ce8c6ba123a5d64da1
|
||||||
|
size 2027568512
|
||||||
3
Qwen3-Desert.Coder.MoE-8X0.6B.imatrix.gguf
Normal file
3
Qwen3-Desert.Coder.MoE-8X0.6B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e6b8646d8a72f87aa20e1128f37f6f897552bbbe5f2a3c28c7136f9f927de7d6
|
||||||
|
size 5312544
|
||||||
89
README.md
Normal file
89
README.md
Normal file
@@ -0,0 +1,89 @@
|
|||||||
|
---
|
||||||
|
base_model: WithinUsAI/Qwen3-Desert.Coder.MoE-8X0.6B
|
||||||
|
datasets:
|
||||||
|
- microsoft/rStar-Coder
|
||||||
|
- patrickfleith/instruction-freak-reasoning
|
||||||
|
- nvidia/OpenCodeReasoning
|
||||||
|
- open-r1/codeforces-cots
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/WithinUsAI/Qwen3-Desert.Coder.MoE-8X0.6B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.0 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q2_K.gguf) | i1-Q2_K | 1.1 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.1 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.2 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.3 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.3 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.4 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.4 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_0.gguf) | i1-Q4_0 | 1.6 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.6 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.6 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.7 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q4_1.gguf) | i1-Q4_1 | 1.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Desert.Coder.MoE-8X0.6B-i1-GGUF/resolve/main/Qwen3-Desert.Coder.MoE-8X0.6B.i1-Q6_K.gguf) | i1-Q6_K | 2.1 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user