mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-23 13:48:20 +08:00
commit e0e69044b0
26 changed files with 217 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f822ad9620038134be7a1ad2f5d322ba3ad6f3d384d29fe43ef24a74b45dc2b
size 7078292448

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d89ebf8029321a056dba7ad1f303e96d8db28fe362c0cdbbc9ffd628f2861b7a
size 6416509920

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9364814fed83276ad6d44b2de562ffe8a46674f2d55b8243494003eb51f1c57
size 10169508832

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:141d094989ccfc40fc4b03bfec82879d1d6f8bdfd1a90f1eae0157c0f1892589
size 9287132128

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0728d56e84d25deb9025bbf46e88d23607cf697116de161d2fda0022726f4d5
size 9076222944

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1db4c5968617d360b9e8af06bb119c335ea844e980b39b64cd5e0386b4037613
size 8181263328

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7da50fff25c9e37eee653b084df9e967e37d4044212dace1baf956b3e706ec04
size 13513063392

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:420a415228c931af6d18c902a312c012ebbda4203536a35f4424b909a0769d0d
size 13299153888

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d70718502a6f4a9af698625abe4634a46a6fb78c10568b44e0d08f2f2165325a
size 12598442976

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7816f0f96c9ea34f9cb44ca66ee143b2190d0af658bd415a4d556cde7add705
size 11849327584

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:979502f654afc33bc2dd885413b2b157a992e75c2e5d93bceef056ca01812e29
size 16368350176

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8146aa2add19e9d06a00a60355b6ce966ee55b0d6935ce801fe3445472a14347
size 11258610656

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d558c167109b8de068f59f7b24d600f281efc6aa4626e37323a3e03c93a496b
size 10519364576

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:516084a8ff31cd22009a734c2f9cfb02c719427033e0338f55fd93f709cba888
size 15900670944

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:971ea76c9bdeff14e0fc6fe0846addc7d71c8e8402ad94b51e2b6aa5eb7507a9
size 14711847904

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5253831d060d036421aded8ad438cc999d91e3b694e136696dcfccb2fae44ee
size 13292469216

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6e7c843a5a60ad94ce21d5e7634a1d50053c5ec0c634236938270041fc44a68
size 17379988448

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dd14a0641e87ce845518efbeab6ef35fd4099ff4186ebcfe329521e73b011a4
size 19192501216

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99eef41262c4b7ab765e14a61ba3dae2ebf77e8534055fbbfac1a3a665756c97
size 18556687328

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c404ee99f253fd2f31b8b257d54091f1b927948bd2f70390a72e10f6c8c9a991
size 17456010208

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba78abb33b8eba9a23595a4fe5646308b128f607232b3b8cff4fc85a6e17353f
size 21725582304

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85171144b7484ed77dfb9a9c99d85a6b9a20ddf5f621593dd0030ea74a9b864c
size 21080511456

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a8cf1663dde426239db79555ad2ee55d07fbb69eceb5bc9e3e46bf82bf893cb
size 25092533216

3
Huihui-Qwen3-30B-A3B-Instruct-2507-RP.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6c04ab01fb051d28b6e121599818888421c4c62f4d4583dd0ee1ce177b13e34
size 122029312

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: thaddeusk/Huihui-Qwen3-30B-A3B-Instruct-2507-RP
datasets:
- Gryphe/Sonnet3.5-Charcard-Roleplay
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/thaddeusk/Huihui-Qwen3-30B-A3B-Instruct-2507-RP
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.imatrix.gguf) | imatrix | 0.2 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ1_S.gguf) | i1-IQ1_S | 6.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ1_M.gguf) | i1-IQ1_M | 7.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_XS.gguf) | i1-IQ2_XS | 9.2 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_S.gguf) | i1-IQ2_S | 9.4 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ2_M.gguf) | i1-IQ2_M | 10.3 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q2_K_S.gguf) | i1-Q2_K_S | 10.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q2_K.gguf) | i1-Q2_K | 11.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 11.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_XS.gguf) | i1-IQ3_XS | 12.7 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_S.gguf) | i1-Q3_K_S | 13.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_S.gguf) | i1-IQ3_S | 13.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ3_M.gguf) | i1-IQ3_M | 13.6 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_M.gguf) | i1-Q3_K_M | 14.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q3_K_L.gguf) | i1-Q3_K_L | 16.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-IQ4_XS.gguf) | i1-IQ4_XS | 16.5 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_0.gguf) | i1-Q4_0 | 17.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_K_S.gguf) | i1-Q4_K_S | 17.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_K_M.gguf) | i1-Q4_K_M | 18.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q4_1.gguf) | i1-Q4_1 | 19.3 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q5_K_S.gguf) | i1-Q5_K_S | 21.2 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q5_K_M.gguf) | i1-Q5_K_M | 21.8 | |
| [GGUF](https://huggingface.co/mradermacher/Huihui-Qwen3-30B-A3B-Instruct-2507-RP-i1-GGUF/resolve/main/Huihui-Qwen3-30B-A3B-Instruct-2507-RP.i1-Q6_K.gguf) | i1-Q6_K | 25.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->