mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-15 19:00:58 +08:00
commit 53016daa86
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
KansenSakura-Eclipse-RP-12b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
KansenSakura-Eclipse-RP-12b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1e5e6dcd74a14d66d072dd61c94e22df09d5552b25f1b2ca0135ce473498dfb
size 3221626208

3
KansenSakura-Eclipse-RP-12b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a37c900b826ed1f364be832f833de70977b8a4eb1a553bc85ca349315bdbce48
size 2999213408

3
KansenSakura-Eclipse-RP-12b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b8d3330101f1f19569ccfa0c0526a6b108f90c6c856ba058ad1360f85894974
size 4435025248

3
KansenSakura-Eclipse-RP-12b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc770ad9a062ed2614a6347e762afc8f084fe2892741fa737fc7dac33b35e5db
size 4138474848

3
KansenSakura-Eclipse-RP-12b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2a8942fea17b945ecc227f3a812a3a8ddefd4916095272916d1dd5295737c7f
size 3915079008

3
KansenSakura-Eclipse-RP-12b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c38b4af3d4f278285bbeacb293900cf2b31841899ea2463a37bd0c146fc0d2dc
size 3592314208

3
KansenSakura-Eclipse-RP-12b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f92079d079241e7d4c36f25d2ad3839b6ff516fd9da4cb17f86394963a5c7ad2
size 5722234208

3
KansenSakura-Eclipse-RP-12b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed7ae4d77fbceb738628fbb6320f2b468d49585a64d355d1c18ef332e0ccf26c
size 5562080608

3
KansenSakura-Eclipse-RP-12b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d13e40b2dfe257df3fba87e9a0c4e46f5c4f41a410171aeaeeda0b73c1d15762
size 5306490208

3
KansenSakura-Eclipse-RP-12b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e764a6e806a2c00ed0ad8c3f3308d907cefbf5407e872b1e5dcd0a3cb5144176
size 4945386848

3
KansenSakura-Eclipse-RP-12b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a46ffd8402b403190362e86f030bd8c4f1cff5332b6a6a4f89df4094a073242
size 7097916768

3
KansenSakura-Eclipse-RP-12b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34fc5d0eec1336d1e97cba3453d159bff6262d80720947415f7e1f4707c0ec3e
size 6742711648

3
KansenSakura-Eclipse-RP-12b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:646508ff8bacbe7bb5791070ef73e5a1a86211e27a4c1a20ab51bfa6863f1263
size 4791049568

3
KansenSakura-Eclipse-RP-12b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ceafbdbba922eb2e59b710fa4b612bc759cb1ebe481ba3e22cd4806fff0c4def
size 4493679968

3
KansenSakura-Eclipse-RP-12b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdc3483840d71c42420b1354d6bc3ea40f1d7712358a47e0eecae801052536d7
size 6561504608

3
KansenSakura-Eclipse-RP-12b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6836d9dd09d8eedbd6c80ef15d24d95be028eb444b04db2e0e3ad0bd39042e82
size 6083091808

3
KansenSakura-Eclipse-RP-12b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb2d7134600ac1ab9235ad84728dc6cce80a10796471a198c5605899f6cd04b9
size 5534227808

3
KansenSakura-Eclipse-RP-12b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:232d118c9ced3a72fa005bfd6f1f388ad189b1cf3d4a7e6e42af2ce9477a6ca4
size 7094639968

3
KansenSakura-Eclipse-RP-12b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1f9a3ea18d169513f51f3103507be8809c51c734265553dc548c157b9563679
size 7795219808

3
KansenSakura-Eclipse-RP-12b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:273ba9c64b1e978d0fdabb232b80e942b8b9560f650d06dc5c3af73129f94269
size 7477206368

3
KansenSakura-Eclipse-RP-12b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9836de9d9174a43654adda5ea225d311ab5ae52d486b1e053427c87105756268
size 7120199008

3
KansenSakura-Eclipse-RP-12b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:130f5fe663a7a455e4c778ec758187671f5a3b06578a94c400a2d550cfdf09ff
size 8727633248

3
KansenSakura-Eclipse-RP-12b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f602e3ffb4b26e25872b6319dc981ebaf19e81ccaecf0941e96427c30994f733
size 8518737248

3
KansenSakura-Eclipse-RP-12b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:942396218e5f0c17bdbb1995f2c2d8121521d149b38c9c4792f1df0893483144
size 10056211808

3
KansenSakura-Eclipse-RP-12b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0131eebfe88e8945add38f2bed3951138e76e8e740d3956797bd234b1a567198
size 7088192

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: Retreatcost/KansenSakura-Eclipse-RP-12b
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- frankenmerge
- roleplay
- conversational
- nsfw
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Retreatcost/KansenSakura-Eclipse-RP-12b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#KansenSakura-Eclipse-RP-12b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/KansenSakura-Eclipse-RP-12b-i1-GGUF/resolve/main/KansenSakura-Eclipse-RP-12b.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->