mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-13 09:49:56 +08:00
commit e093506f99
27 changed files with 226 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8349f58c058acc70516b36d518f5489d193d16e50c8bbe6501df4883f2b7f628
size 543795456

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30dcb1ceaf9eadc7d6f7710c94c2b00afa5bfb243de512ff5861e0570a721c44
size 515778816

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6857e49a129be610f4f539b5deb7982cdeb1b1e071428535b724dd81c986b71
size 695183616

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4270f54c2e13e4367b50c97b40d2ab309acb8b7b2dd1b69801255e7b69c50772
size 657828096

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb3bbf58b1a911ba6aa2ffd5b0797e67a2c327ffa5a0e39314d4cc959e26c363
size 631515392

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc6931a72f5e464177aa4583d0b11a0fd636b7d8572401722c69784609dd0ae1
size 590489856

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50a6ade74ca85c882be5a18a444255f86f4f960b1eaef69a85af65f8bd423193
size 895664384

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f08a6345a042cb06400e570beb632bd5bcf3466ba406b783abf7455fd2bb5507
size 867254528

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8bcbcdc804b476984c1ff5ae5c2539c90411f224bc605808051210a6253cc72
size 834224384

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9e1bdf35055780c4006438064770216d9bb1783037c50c1b3ebb08c7fedf6e9
size 754362624

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6151b6e3f859470bb3a8a0d6b1ae04842b05d5b0d230ddfc6271356031535d43
size 1054425344

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9a438f6cbcdc986217892af11609b79225b0a420ab9d327d64dda037cb19d28
size 1010385152

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7fd14bdb9b9b3a9a2837f203c3e74854fbcd2bc160387dd7b73183c0eeb60e5
size 777797888

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df7b6d075635276daf73a126a0106a90dd27c5ce816a6c53fad00c61fbeaa464
size 732971264

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c86f75ea7bb05e34ad16b8703a187528cf00e10a4770d5f94705e186cd28404d
size 1003503872

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cb5b08a994e8a19195ecc0eacd9ccb6bb69115f664b7f4cc890ca79e469716a
size 939540736

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbec5263893ffbfca16e8825d4e228a4c2aa922cb959a3430ebd3c89b7abe989
size 867254528

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1945ab9fcaffaa9ba449e05ba38fc2db3aa3b0a4d14bb8dd1128ba9d569bbb2b
size 1056784640

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0283adfc3136768600e3c8e7eb56084b00fc2db4893b478219333e212a127ea9
size 1142505728

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bee225f5f3f39f317cfc9c23a9cbe192ea54be0bbedb69c6a5bfb1faff1992aa
size 1107411200

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffb11649562bda571b0283d8fc2c1c361105ec28714281d4caa8a73f2b0a33cf
size 1060192512

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:daea3f19800b7400b36394e169e4a447e5baa5ea74181bb60036eaffef2f533e
size 1257881856

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46504bdf661c20eec557133f9db70f50f146991410a3649660a650019e86de47
size 1230586112

3
Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ceaf5f94e28c0124d592ee656bc0be706585f9b64833856ced3fd8244746d47
size 1417756928

3
Qwen3-VL-2B-Instruct-abliterated-v1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccac4152c3a86354d48b48597e341af6017e09557d2420043647e4d7953e7c16
size 2094560

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: prithivMLmods/Qwen3-VL-2B-Instruct-abliterated-v1
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- abliterated
- v1.0
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen3-VL-2B-Instruct-abliterated-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-2B-Instruct-abliterated-v1-i1-GGUF/resolve/main/Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->