mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-29 05:05:19 +08:00
commit e11625a64a
27 changed files with 247 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:accb37744a23089654997102bf5a74387df7292c0ead473746d94fc83807abd6
size 731572672

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e0698f8fea3728a2ea91b0ee2197544ede7f23b459a6bf9513ce11998f00d1a1
size 677038528

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5787958fe0bf26935fdc02c4672e270d467b25b2abb2b0e39b75a0ca8f8b91fa
size 981215680

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:409b0d7f794e08f59afe85a529dcc903d795c9c6cafe18d461452f3b822e7c11
size 908503488

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3242086c89e12e20a377cf314992428bd3b3af7793106ff31997400159eafac
size 896223680

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4131006ae440f72857ccbb7bc4cd7e715ec3c282fc52ae4859774fb642b65e4
size 822462912

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a09018b3d042d3f0c3c25332b9a7d554e6eb18be42c06d78e68430992b14148
size 1284868544

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e3e614400aace7b49c21eab653072737a3761725ccd776a5259d8c1a73c708a
size 1270524352

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90b57fe2d7476ce8c16d78d32a29b488c321601a1613f531cbf30c78fbb09444
size 1221077440

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:252632899a7ed95df29cac20e114414e193cf83f4537c0d4991cdd617edbde12
size 1120528832

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9ee414df639eaeb96b42388e65b723b87876a0b154442d2003f5b53635ffa2a
size 1593895360

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73bc48ca53fbe83d43b2c8ad0aad40fc80d52eb0784f8e51b3d23b4c0fea7ee3
size 1517808064

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:870fac7fc953b5fe77af08b4244bf4d04422b8f142d299070fe229db2dc542f6
size 1094592960

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b50856dc03b53b9c5ceba7380378dae625dc65472822e107c943fee87ac2659e
size 1038723520

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be14740cce517bcd9d5163f9d13cd7b1c42b29f8613a0cf8da24062681c94789
size 1451649472

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3c05dfa9e402adf3170571e82d449c3993e0d88efa2a8d850e32067be34948b
size 1366845888

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26599a2a8577b4acdafbe7687ed380f4b15bc00e68741ab37517c2adfb9bcd79
size 1270524352

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00e04312c2a25684d6ccd9596b2164966d877c8f8ebc57e33e9a8586ff88a446
size 1598024128

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:357e8d66e0524f0a4f535ee1effcf1bf9237be9a605d86c667300d2ec0a33f07
size 1746069952

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a58a8f72b1c35665633ce27e74ab7296363b3a85a24934df4e6165b3bbe5f1ab
size 1674455488

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d65bbe8688c33506ae6bbe7527331dcbaa699ba4b674ec2f368e82fe864146b
size 1602677184

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18f08b5c4fcf1a7365c13c56c6ebedadaf167a0ac567b5f96b0ca419c37c4e88
size 1939745216

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b04df145b004ea928a00cc1696884ce600bb8b04b9ebf8344c87e148ff4d7818
size 1898244544

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a2d2a28ee6317060120121252a5822fbef75e8cd3de9b9485380ed1f8861e48
size 2221615552

3
Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e79dd29d130d9e8756bb39bd958af0dfeca315ecaf1040cb8fd853eb59b1293b
size 2430848

112
README.md Normal file
View File

@@ -0,0 +1,112 @@
---
base_model: Indexnusrefather/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1
language:
- en
library_name: transformers
license: other
license_link: LICENSE
license_name: lfm1.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- safetensors
- instruct
- thinking removed
- no thinking
- instruct only
- creative writing
- RP
- Roleplay
- creative
- writer
- ERP
- v0.1
- early version
- experimental
- edge
- lfm2.5
- finetune
- Unsloth
- Reasoning disabled
- No reasoning
- SillyTavern
- SLM
- Mini
- Small Language Model
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Indexnusrefather/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q4_1.gguf) | i1-Q4_1 | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1-i1-GGUF/resolve/main/Nyx-RP-Mini-2.6B-Instruct-2608-v0.1.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->