mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-11 01:32:09 +08:00
commit 9ab3740448
27 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: SykoSLM/Stablelm-Roleplay-V1-BetaTest
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- base_model:adapter:stabilityai/StableLM-3B-4e1t
- lora
- sft
- transformers
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/SykoSLM/Stablelm-Roleplay-V1-BetaTest
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Stablelm-Roleplay-V1-BetaTest-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf) | i1-Q6_K | 2.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84bc1a33c82b4b1d8f370071d42852c424abeb3c651953b82f4e9731c60a8960
size 727873408

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6b18b5b09ec254a531c26c3a02724b5b30b34c3c329c8e2b208e9fe981e178b
size 679888768

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:435fd5e6ca7a0963bc8a2d8fa1d4a143a89941e4675c46b0942fac7742411e2d
size 1013418368

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ab2b7ef9ef101cd01cc1e447152c592f9dcdd7b3cccbc16263cf96ed8bce941
size 949438848

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b40727774d8d5eebad2b4ba7be62872fbf7a9bf97f31b53e5056a2d93b99bdbf
size 878380928

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65498fe90520bf9c33c2e03e28727f47232458154947d0fd480ce9515bf92464
size 807847808

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26d90f00260ce5334c5620d349be4e200c5e292fe9ff51f02008187eee06ace4
size 1319555968

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc87da64f12831f3b82608097970c14fb708b4cac520399269fad77253c272d0
size 1254450048

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94649cb65a91f4d145a158da2a35879e242366c537abc606a5ff999da9e848a2
size 1194976128

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46776e1b3b3f12a7efa2029bf0432209c9a9487e891359e6bca2f49effe25a64
size 1102014848

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a57da6a939eaa50761861f327dd68a50b2161cce46c431f0453ab0346a37f81
size 1608572288

3
Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dcf80c80779dddc888694cfd459ec2765ce092e1a717edb40337d8e78fd7e67
size 1525249408

3
Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03e09fdc119a1659954edff142ecea83b574bc38988fcdd2aa22d7e68265647e
size 1083756928

3
Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5db8399e959c8525438821f9039197e11355c45634b8112922ac8c99dfc9e3a
size 1000239488

3
Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e564767007e5939e6de56af5e0530aaebf1c1f46a095e9249c33c583f5e6d16
size 1508565888

3
Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:228f5fbf2fccd15f53b30e9f65ab181fd2e3111ca5f8fe0c753a5d2ac3f3e6f6
size 1391420288

3
Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9be4f5bb9b61b0e8c84aaf09238168722560dfd56026b77a9a21e256edc13f9
size 1254450048

3
Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0830de240e413c7926335618ad60066ab0d1498e3ad3affade980f3b56fba11e
size 1612995968

3
Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b895e69d3525abb2c0ad9d580f58637f4b13bcc250c939edaa0f07b52876f65
size 1775218048

3
Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0a1b65ccd1b98d5c40ac5425bdcd3fd94402235476681c43057bee3125afdf4
size 1708596608

3
Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:644096d275991ef17ab2da4b099fd7075b1852f8c518dd5045aeb42d8e70b0ee
size 1620696448

3
Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f4f0e66b48983a9a514b5f022e13e0267a7486c03fb99a73103fb3f389a0057
size 1993391488

3
Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3203eae7575c40faec4499a9cb69a564e62b78e029853a7916f9471b2020b53e
size 1941863808

3
Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2111d0569841050feed2308cb5caabda3686330d46ea01745c30fd24a055cf2d
size 2295986048

3
Stablelm-Roleplay-V1-BetaTest.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d20b9f62ea8f3de6ecf2d4e749394a0534078512cdca98a8eaf866566fc36c2
size 2885280