mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-26 18:02:26 +08:00
commit 458dbdd6e5
27 changed files with 234 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:979712eb6c5f5326ba68f0f03fcb1c6ade85fa955007d818ca26c476621cc72d
size 3164728928

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49b4f75677531242ae904215fe4c95d385058d24c416fb4c1553dec70059502b
size 2947415648

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac25feb5fa3a95e51986929631b012505b9b87e6297c5ce430696b7f853833fd
size 4310462048

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6eda7f6f3f09bc152f5be6261ee3e625116c6a214b17d093bf2d5acaaff88acb
size 4020711008

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f4cb0c24b4d3829b17e2ff54541d3f58ef2b1f395fa673f8426f89609104839
size 3840261728

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2f82d26c78652fbe4038c4b08040ed9e61d761d3adbc7734c0ee7fda151eaf4
size 3526917728

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d51fa34e68fba13d43efca5adc0e8f57dff3ff1d0020ce7db6c8bc7af85059a7
size 5655723488

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ae75a2c83e6ab1c7e711d7369f028f3f8ed0395001a0069ab24e7089e1b6ab3
size 5458316768

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce6017cf44885c05d3031a8ce623cfe605f686045029bb6ef6b87af0975b4fc5
size 5206167008

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1140ff26a15fc6b89fb07c48c663ac6b503e49a15b3d855ed48aa91eb5bf1a21
size 4784901728

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b67ad050a0c9fcf896436eba1b1bd10fad09f2397ed971cef129e5468e981ec
size 6887165408

3
Erebus-RP-12B-Instruct-2608-v1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08b20af7be38c386f16e2cae0a365a80beea980a2fb42568fa8cd496a74d4b34
size 6550965728

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be47c57af436f04f61d689d0e6db7bdf39c24a7d2df416cc8b6fe0a0a19a7496
size 4768222688

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:822ae9a3324b7674ec68381464d590ff15b34ff055aff9b446949e707f53e22d
size 4448611808

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20d90b80f1f50adda29b37e98ea1c94999b1955f393738fb8e59e12df07b021d
size 6480186848

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d23f8ee35e05d90fc9c8cb020090dc6b160f061ae3ee80d8566d2fed5e67e1d7
size 6008819168

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a09e8907412b269acea87415505217e2e9f60f299dba2d98731009b094e6e879
size 5458316768

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:869f4f9d0b7df5f7f60d08e7ab9eb0331991796bc72574e019bd039945ce3e96
size 6909283808

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60821db0c07da23656197145a4252404a3f1456f3ee7f3fa53d8787ab49e8bf9
size 7559564768

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbf82b7f762998bc0e9f0f470d5015978ae4e5d7ea413df57e7b15f061ee1866
size 7300779488

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c8887c92d6369b5817004bf0f27e0a5da5ca7473e756a7a8a07d6560a61dc7d
size 6935334368

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab03e2872f92a4b32d8b8906f6250183cf70fcc4b22d17ce8d92c81628ba03fe
size 8445038048

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3480f8358117d06438d9d45386245343d41ba87f99c4bde7adbd59ff9d60bc79
size 8231964128

3
Erebus-RP-12B-Instruct-2608-v1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2b0a6d55451c1d9fdf789bafdf124ea397e3e0180d632826cdb33a5ece532a2
size 9660812768

3
Erebus-RP-12B-Instruct-2608-v1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95fc77b3b0f0c500f36960889420b674669d1401069b592958a094f22b5abc68
size 7473632

99
README.md Normal file
View File

@@ -0,0 +1,99 @@
---
base_model: Indexnusrefather/Erebus-RP-12B-Instruct-2608-v1
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- RP
- Roleplay
- Creative
- Writer
- gemma3
- finetune
- ERP
- Instruct
- v1
- Creative writing
- experimental
- rich worldbuilding
- safetensors
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Indexnusrefather/Erebus-RP-12B-Instruct-2608-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Erebus-RP-12B-Instruct-2608-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/Erebus-RP-12B-Instruct-2608-v1-i1-GGUF/resolve/main/Erebus-RP-12B-Instruct-2608-v1.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->