mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-12 00:23:00 +08:00
commit 9c153ed704
24 changed files with 195 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

56
.gitattributes vendored Normal file
View File

@@ -0,0 +1,56 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: aloobun/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- Roleplay
- custom_code
- storytelling
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/aloobun/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF/resolve/main/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23e4a939493419e8533a530cd9e02408c6e4d41462a2324384f970579904eb16
size 236573824

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abed09cf183dd0fe7a2a8f9dd54bec1209839996dada669225448954fc86e012
size 230730880

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e3a04f79db3909b70aa1170e183236f4a272d64cbe4b81bbc797cf46d49513a
size 285454464

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ac76e6b1ed8c2b255cedce64e9b60d794e908fd90aea07bea2658634982d1dc
size 277663872

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c6e50d1d77725c6b6601da0164add039e0ca3b7f7531d95e5012ce36ffac356
size 254889088

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c3d1f8b06b5c030367f1ff94eef1fdaa00de7cad133028588ff90ca39f17a02
size 246312064

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b027b2a256044045a365bebb69246ba944f5f84e5f09958f3ff96eeea63ba7d
size 341218432

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55fa41252c2f533bfab448044739f5e7cbc2f338e2192ad7d43ed55e435616b9
size 333384832

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0893152ed302d29fae39bb402184e4f8d192c5f58e98fcdd230e765ddf86afc
size 326159488

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1e247b64ddb5c4c6a9990d6fc320750b6c0b033933c107f2566fc7698dc27fb
size 296304768

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:653f127d54acbe800b3b189a3aacba3884f836a2238d9e19ffc76ef20738fe6d
size 380496000

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a333c68d0f292ce0b8c90c003f69a6056d14986c80259995c0cfaa63b64e857
size 298414208

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0913e3289942ead31133ca151452557d5048fe7783164fc24624eda171018ce
size 364203136

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a91ea1efe982237e92fca58686be959390348c87c1ea454205f279617c07e02
size 349883520

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca310146f50e20e2397bf9579749beb5b71a928298fd63487c0e956fe8b74ec7
size 333384832

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbcca329345a1d23525d22aa17e4f51855db57ef47c9e80957d33a65219bd3e0
size 395532416

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2dd80f98327c4ebf5a8f006791d9a8cbad1b7206fe29f2184a2dce7394f1e82
size 407156864

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd91b498e13695e20670288e6af7443d03364009bb8b19e93c44b826294d76bc
size 396597376

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71f8b555417b59c78f6d44ce9196b2be6f4e8d30279a4acf4d63dcc557f5cd6d
size 459241600

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af28b7325d6d233d12d6eb3397e91742b0689379170944101d76b21f63783788
size 452974720

3
Reyna-RP-Qwen1.5-0.5B-Chat-v0.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0ed64f280abb44a670e0c0a67dcb46d5c5150398a95f4f75106ebe6fbf9fec8
size 514581632

BIN
imatrix.dat Normal file
View File

Binary file not shown.