mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-31 21:40:20 +08:00
commit 567402ec7d
27 changed files with 234 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8ab14d858e7dd86a933ad393d69abb5ea4a8d7ebc17923fdbc45b87366eec44
size 722075520

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c994fc77b0d57a0f4a5716131cfff9e515678a49aba46ccaacfe51ffd7b91a3f
size 672923520

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f063327931ec42156170a185f37741997cfe20163eb957ddd103205df940d8d
size 958536576

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2141d61d5a020d180672fbbac5264c3e3a774c7ca8d52b919e5e59775ebc0b5
size 893000576

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e64ade545f70686f16191fce55fd831f9cc9ec7c188e3dd22cc438ef502c27c
size 869531520

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:353fd9c446f5206a977cd8196fb568338bcf6d90072f2e85c2e7357ced54aeb1
size 803995520

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7f50c2ae7ba676f63681e57e9ab22c581b2f08e6d04c567bf28cd5b09dd18c9
size 1284728704

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8319495e4724209d6c0c6d4b6ba031531174e57c25c89e615a42879a197409f
size 1237936000

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b9a5e09db1c4cca03e26b1eeef6b4ab4cffaee9233d598ecbe2ae3a0bf3d7e8
size 1185638272

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee3bfc5b8e5737ec81b8b33bb243be5327b51c76e8f3479d177c2656680bb828
size 1111759744

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b8c9ae1daf318d740e8c18922baece6a0393ac89a0d324739a7ca004ffb7b9f
size 1547154304

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b89297bb55c1bbdd37697f6d65791cfd293ffcb82d82e3fe82f66de91d1ab5d
size 1474397056

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f85f848457054eb712660f9cde5bae835850b11d56e59655e4eaa53d6798939
size 1073040256

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9461d3c933349af254fc37bb3196b60eb63220dc4fef71f34535660b974e8f1
size 998067072

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf65baccde9f52ec46909675e02450650623af53f1c6f11f78dde8794d561262
size 1404462976

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6bb8728ffa983a74dc9c95800b31311c7734a64f81c7feb868f9981b10ca7c1
size 1334667136

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:279667ca21caa614bff5fbf98f140e1ca84c36f0b202729ccae97fd6c5803f2a
size 1237936000

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bb4a8a285e3d4df97d6fde3cfbac69a81b491dcbed476041a073546a2ace264
size 1544532864

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28d693d2955b6092f7aa8026ff9d7712535e860a6fd68fa143d27612663998c3
size 1688998784

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:456d6030176c05f6ded2f80d15375f29d515578b8aafa0e3bf679b98c5ab57ea
size 1637987200

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf43dd990933edf62aac118b75a0f7c1f44fa3051d191cb22f331b182e4e096c
size 1556591488

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36dfe68204658e05983e0b4b6c56a832396795a63954d7f37e05365d2e1ba883
size 1884976000

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db0a00a662b7f55a5a72ec3152d575ed5246ae5cd3beb4e5f01958fe2e69b3e8
size 1838183296

3
Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6cff37c86bb72a2439ca728337dee012edba03841b3cd673d62a99ea0bf4f1e0
size 2155200384

3
Qwen3-Neurotic-Experts-8x0.6b-v2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a7a9739ad54f6b75288b637db93cc97d76557f69e93e03b1e7d7918be38ca5e
size 5312544

99
README.md Normal file
View File

@@ -0,0 +1,99 @@
---
base_model: ItsVictorTube/Qwen3-Neurotic-Experts-8x0.6b-v2
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- moe
- frankenmoe
- merge
- mergekit
- lazymergekit
- Qwen/Qwen3-0.6B
- suayptalha/Qwen3-0.6B-Code-Expert
- suayptalha/Qwen3-0.6B-Medical-Expert
- suayptalha/Qwen3-0.6B-Math-Expert
- suayptalha/Qwen3-0.6B-Diagnose
- suayptalha/Qwen3-0.6B-Psychological-Support
- suayptalha/Qwen3-0.6B-IF-Expert
- 90dkn0ws/OpenR1-Distill-0.6B
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/ItsVictorTube/Qwen3-Neurotic-Experts-8x0.6b-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 1.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_0.gguf) | i1-Q4_0 | 1.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q4_1.gguf) | i1-Q4_1 | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-Neurotic-Experts-8x0.6b-v2-i1-GGUF/resolve/main/Qwen3-Neurotic-Experts-8x0.6b-v2.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->