mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-07 19:26:13 +08:00
commit 24fd0eac5b
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
deneb-v1-3.8b-roleplay.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: Sakalti/deneb-v1-3.8b-roleplay
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- phi3
- trl
- sft
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Sakalti/deneb-v1-3.8b-roleplay
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#deneb-v1-3.8b-roleplay-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.4 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q4_0.gguf) | i1-Q4_0 | 2.4 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.4 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q4_1.gguf) | i1-Q4_1 | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/deneb-v1-3.8b-roleplay-i1-GGUF/resolve/main/deneb-v1-3.8b-roleplay.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
deneb-v1-3.8b-roleplay.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38027b24a325c471534ddbaaff28002d1fc49f2293cb059adfae56f1b7914a04
size 1159035936

3
deneb-v1-3.8b-roleplay.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddbf6c6d1506e17597bb5f38223fa3750ab27f75ce5a644b30fcb9cefb06c24f
size 1092975648

3
deneb-v1-3.8b-roleplay.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b48bfb7714ce3d4adbc4ccb281bf394eac25a0b855b8e18dc978e24bd1579b49
size 1507425312

3
deneb-v1-3.8b-roleplay.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:410befd5296298415faa57c05917f4f55533da135707dff04886ac8535041cfd
size 1419344928

3
deneb-v1-3.8b-roleplay.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b3629f757a19e5b3694e15ee7c1607112fb0c470136758390824dda8bf0d6cb
size 1366653984

3
deneb-v1-3.8b-roleplay.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ae77a82c1c0e8bdfaa4efd02f284fb88bb63f3456935c3b17af024539796693
size 1269136416

3
deneb-v1-3.8b-roleplay.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d467ba1099a58392253c27c8e555f245d3e116797e19b59bd2179051a21ff50
size 2017656864

3
deneb-v1-3.8b-roleplay.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52e61ac90ea5db02c19ca1e22d376695908ba78ae23caa795579f4064690abdd
size 1897332768

3
deneb-v1-3.8b-roleplay.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e58ecfa8374a7d0559a2f7f572b08bddd856a2427de2f282003877e7e59d895d
size 1840709664

3
deneb-v1-3.8b-roleplay.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1bb5313f7debfab223995e4aff014401fbe1b5f44216f059e41c1024a319c96
size 1678867488

3
deneb-v1-3.8b-roleplay.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ad4bc55ae42179895f95ef17813727f23707a7848ddcb631ede33e9ad2989dc
size 2325151776

3
deneb-v1-3.8b-roleplay.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:beb624c239009a600781f5be88f34bd4f3f78d882a897937ca6e56b118d9672c
size 2224488480

3
deneb-v1-3.8b-roleplay.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbda5c6bde67a5eb80f5180df873637a34f37131cb5a5e88246face425b1c1d9
size 1682636832

3
deneb-v1-3.8b-roleplay.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d68266af6923de9417729d9d5e3de8676037f3831ce93cf2534d8d96002905c
size 1593770016

3
deneb-v1-3.8b-roleplay.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aab9b062f60f6c666ce927d91e59bcd8fd9305a1dbef279619c939c2f4b85343
size 2249654304

3
deneb-v1-3.8b-roleplay.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5ab62badf08a5e1ed3a1c860264f1715bee73fae7e8b0da2ce3290743fa7d7f
size 2117533728

3
deneb-v1-3.8b-roleplay.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19dc36901174a9a382b3fe7640586af64c7a514ad53e5ec8511036c0e5ce8a46
size 1897332768

3
deneb-v1-3.8b-roleplay.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11e1f00af879e8da6adfde91d963dc92843139c9eab24239cd270260cf9cb712
size 2331443232

3
deneb-v1-3.8b-roleplay.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d24600c2f491f0a3c5b802a549660ea3a1320d10c1e6882341694bbe31674c20
size 2526478368

3
deneb-v1-3.8b-roleplay.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28475514acfe97308674b2e8de0b34af30d041b65c7e1c3d7740546613806f66
size 2491875360

3
deneb-v1-3.8b-roleplay.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdc0f99e9b14a30990a1864b43e54ec24c9984974bb2138a6427e8d5ab0ada04
size 2337734688

3
deneb-v1-3.8b-roleplay.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57efb94e38516b3834a3d07268251ba26a56661d1fe51e6b2cd9be7cd651e141
size 2848129056

3
deneb-v1-3.8b-roleplay.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b4aa158ee90d7b29bcd6b145d0ca7f64c9a48cc232bd4e81e9c6ed54235f110
size 2727804960

3
deneb-v1-3.8b-roleplay.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd5bb0d8319321f0c10936e245159da64c379ad97a8e74657b0ed4a8d0066055
size 3155623968

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf6758edcfab30a9b202407407aa03f66e14f6ec6fca083c2e14a686d32d4cb0
size 2232603