commit 9ab3740448f14e604d591522039194073f50def8 Author: ModelHub XC Date: Sat Jul 11 01:32:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..092b0bf --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..926021f --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +base_model: SykoSLM/Stablelm-Roleplay-V1-BetaTest +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- base_model:adapter:stabilityai/StableLM-3B-4e1t +- lora +- sft +- transformers +- trl +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/SykoSLM/Stablelm-Roleplay-V1-BetaTest + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Stablelm-Roleplay-V1-BetaTest-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Stablelm-Roleplay-V1-BetaTest-i1-GGUF/resolve/main/Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf) | i1-Q6_K | 2.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf new file mode 100644 index 0000000..34331a6 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:84bc1a33c82b4b1d8f370071d42852c424abeb3c651953b82f4e9731c60a8960 +size 727873408 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf new file mode 100644 index 0000000..92415ee --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c6b18b5b09ec254a531c26c3a02724b5b30b34c3c329c8e2b208e9fe981e178b +size 679888768 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf new file mode 100644 index 0000000..3985719 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:435fd5e6ca7a0963bc8a2d8fa1d4a143a89941e4675c46b0942fac7742411e2d +size 1013418368 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf new file mode 100644 index 0000000..a0ec7e3 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0ab2b7ef9ef101cd01cc1e447152c592f9dcdd7b3cccbc16263cf96ed8bce941 +size 949438848 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf new file mode 100644 index 0000000..9938997 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b40727774d8d5eebad2b4ba7be62872fbf7a9bf97f31b53e5056a2d93b99bdbf +size 878380928 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..434a280 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65498fe90520bf9c33c2e03e28727f47232458154947d0fd480ce9515bf92464 +size 807847808 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf new file mode 100644 index 0000000..2f13bb8 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:26d90f00260ce5334c5620d349be4e200c5e292fe9ff51f02008187eee06ace4 +size 1319555968 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf new file mode 100644 index 0000000..43b7cb8 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc87da64f12831f3b82608097970c14fb708b4cac520399269fad77253c272d0 +size 1254450048 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf new file mode 100644 index 0000000..d9e02ef --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:94649cb65a91f4d145a158da2a35879e242366c537abc606a5ff999da9e848a2 +size 1194976128 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..cf3dd80 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46776e1b3b3f12a7efa2029bf0432209c9a9487e891359e6bca2f49effe25a64 +size 1102014848 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf new file mode 100644 index 0000000..6b2dc1f --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a57da6a939eaa50761861f327dd68a50b2161cce46c431f0453ab0346a37f81 +size 1608572288 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf new file mode 100644 index 0000000..e0fd351 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1dcf80c80779dddc888694cfd459ec2765ce092e1a717edb40337d8e78fd7e67 +size 1525249408 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf new file mode 100644 index 0000000..149e89e --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:03e09fdc119a1659954edff142ecea83b574bc38988fcdd2aa22d7e68265647e +size 1083756928 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf new file mode 100644 index 0000000..c9fc766 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f5db8399e959c8525438821f9039197e11355c45634b8112922ac8c99dfc9e3a +size 1000239488 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf new file mode 100644 index 0000000..db198d8 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e564767007e5939e6de56af5e0530aaebf1c1f46a095e9249c33c583f5e6d16 +size 1508565888 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf new file mode 100644 index 0000000..e03000b --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:228f5fbf2fccd15f53b30e9f65ab181fd2e3111ca5f8fe0c753a5d2ac3f3e6f6 +size 1391420288 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf new file mode 100644 index 0000000..05ca614 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9be4f5bb9b61b0e8c84aaf09238168722560dfd56026b77a9a21e256edc13f9 +size 1254450048 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf new file mode 100644 index 0000000..b71a30e --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0830de240e413c7926335618ad60066ab0d1498e3ad3affade980f3b56fba11e +size 1612995968 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf new file mode 100644 index 0000000..0240208 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4b895e69d3525abb2c0ad9d580f58637f4b13bcc250c939edaa0f07b52876f65 +size 1775218048 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf new file mode 100644 index 0000000..54f8a40 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d0a1b65ccd1b98d5c40ac5425bdcd3fd94402235476681c43057bee3125afdf4 +size 1708596608 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf new file mode 100644 index 0000000..3de46ec --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:644096d275991ef17ab2da4b099fd7075b1852f8c518dd5045aeb42d8e70b0ee +size 1620696448 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0297dd0 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f4f0e66b48983a9a514b5f022e13e0267a7486c03fb99a73103fb3f389a0057 +size 1993391488 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf new file mode 100644 index 0000000..126ca7c --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3203eae7575c40faec4499a9cb69a564e62b78e029853a7916f9471b2020b53e +size 1941863808 diff --git a/Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf b/Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf new file mode 100644 index 0000000..415d6c8 --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2111d0569841050feed2308cb5caabda3686330d46ea01745c30fd24a055cf2d +size 2295986048 diff --git a/Stablelm-Roleplay-V1-BetaTest.imatrix.gguf b/Stablelm-Roleplay-V1-BetaTest.imatrix.gguf new file mode 100644 index 0000000..4f6176e --- /dev/null +++ b/Stablelm-Roleplay-V1-BetaTest.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8d20b9f62ea8f3de6ecf2d4e749394a0534078512cdca98a8eaf866566fc36c2 +size 2885280