mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-23 21:02:06 +08:00
commit f6c224b99d
26 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b3b5ff4fa9f0eda9a666a2c4c0c99d67c1b4d41b6bfa2830d875628100f3e45
size 3870226304

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42d64ba3413f92cf1dce4270b43868a291ba0a05b739663fd75c5d84d4f88036
size 3605911424

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c31cd05caf8ba4a9dc14cb78eced9eec3e58a7fc9d69f51cea77739fe331ecf
size 5353856256

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1672876c05f00d012f56f069827b902b8bc39998668f891f8e42e0334d1dd0c5
size 5001436416

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c853a9d661e78b5762e8864ac4dccb99fe7a81725ab4e307b00c4ae6610577b2
size 4702492544

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba0a7f60bd907739a595b8bdb670083065b8c72a6a8e8da951175bdc09f14f20
size 4310751104

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5bf603a9c2724e5209dc21a16a89d77d041271cc6205c8d054fef5ec054f56d
size 6913976640

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d99ba71b8422a50c620fd9b15602b332963f90eb618594f69be1cc7123bed23a
size 6690457920

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:177ac2e232fb9ae86b45df169f41e14edce329648b609b13d72e5f2b8a8ad0c5
size 6380800320

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c121b8de6154810d78a8124763a90f9fef1eeb545826f801d2321e1ea950684
size 5944417536

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39509e35a83aadf15234510437457b8182cff6f8e03ca4b2999b65334d334fea
size 8546350432

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3368fafb0cd2886fab14b016652182bffd53a75df383453070c2ecd8f3f767a
size 8117071552

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1266fa0a39d42780a80d69f37f5085569db0c8200995b121b38072c9a54e2fc4
size 5768143808

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b89349e5a6cbf5fbff1212c4307a0bb6d1eccf8097a35127ef52852ffdb35acf
size 5394834368

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbf163ebc3fa985731c1dfe05fd15afc31571cfbec6e7f75f87fdda95ae35fb0
size 7922207040

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06970f849c5e194a1009f7d2f4c7f2bb0ff3665cadacf51f68df44329e35f4c1
size 7336642880

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5aba0dc2279c8090b550ccd0ff79514430437f80bb3701455510b0b676061940
size 6657034560

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:043e8d555a59ea7d8e8964c629ed727c1b06076ffaa3fc7d3586a5cf8fb32143
size 8541435232

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f8dc09fd767ffcbee5e0a1a68681dad4bc5ffb86dd047e447fe71c6968f0d1d
size 9389179552

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32c202ea875ca92b186593d4e5f646f45a340fdaa19ee118a9832cdabab3ed10
size 8985277792

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cfe5b2dad8dc06620094cec72aa90a5a46c678dd8562b107627b832d0a8d2a93
size 8570598752

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:444cf34652288169fc72e32abdaee8f76b9c48ec80f1edb2f4ad19c10a26c87a
size 10505785312

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e307e2c93fdf40161148ba347e980ad226afb89705e51e9b39e73f19114d1e1
size 10263465952

3
NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a41a37cfbcc74f2a07025e9f65f14e00bf1b87ebb0a484a7fdb030a07135623e
size 12121324576

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay
datasets:
- Lunzima/Semiboobs
language:
- en
- zh
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
- sft
- chat
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-i1-GGUF/resolve/main/NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->