初始化项目,由ModelHub XC社区提供模型
Model: MuXodious/Rocinante-XL-16B-v1-absolute-heresy-GGUF Source: Original Platform
This commit is contained in:
39
.gitattributes
vendored
Normal file
39
.gitattributes
vendored
Normal file
@@ -0,0 +1,39 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
164
README.md
Normal file
164
README.md
Normal file
@@ -0,0 +1,164 @@
|
||||
---
|
||||
tags:
|
||||
- heretic
|
||||
- uncensored
|
||||
- decensored
|
||||
- abliterated
|
||||
base_model:
|
||||
- MuXodious/Rocinante-XL-16B-v1-absolute-heresy
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
Static GGUF quants of Rocinante-XL-16B-v1-absolute-heresy.
|
||||
|
||||
---
|
||||
This is a **Rocinante-XL-16B-v1** fine-tune, produced through P-E-W's [Heretic](https://github.com/p-e-w/heretic) (v1.2.0) abliteration engine with [Self-Organizing Maps & Magnitude-Preserving Orthogonal Ablation](https://github.com/p-e-w/heretic/pull/196) enabled.
|
||||
|
||||
---
|
||||
<p>
|
||||
<b>Heretication Results</b>
|
||||
<img src="https://img.shields.io/badge/HERESY_INDEX-ABSOLUTE-white?style=flat-square&labelColor=101010" align="right" width="250">
|
||||
<br clear="right">
|
||||
<img src="https://img.shields.io/badge/RENEGADE_CHAPTER-SOMPOA-FCC900?style=flat-square&labelColor=101010" align="right" width="300">
|
||||
</p>
|
||||
<br clear="right">
|
||||
|
||||
| Score Metric | Value | Parameter | Value |
|
||||
| :--- | :--- | :--- | :--- |
|
||||
| **Refusals** | 3/416 | **direction_index** | 22.20 |
|
||||
| **KL Divergence** | 0.0182 | **attn.o_proj.max_weights.0** | 0: 1.26 |
|
||||
| **Initial Refusals** | 339/416 | **attn.o_proj.max_weights.1** | 1: 0.64 |
|
||||
||| **attn.o_proj.max_weights.2** | 2: 1.41 |
|
||||
||| **attn.o_proj.max_weights.3** | 3: 0.94 |
|
||||
||| **attn.o_proj.max_weight_position** | 23.86 |
|
||||
||| **attn.o_proj.min_weights.0** | 0: 0.97 |
|
||||
||| **attn.o_proj.min_weights.1** | 1: 0.03 |
|
||||
||| **attn.o_proj.min_weights.2** | 2: 1.18 |
|
||||
||| **attn.o_proj.min_weights.3** | 3: 0.93 |
|
||||
||| **attn.o_proj.min_weight_distance** | 18.57 |
|
||||
||| **mlp.down_proj.max_weights.0** | 0: 1.23 |
|
||||
||| **mlp.down_proj.max_weights.1** | 1: 0.70 |
|
||||
||| **mlp.down_proj.max_weights.2** | 2: 1.35 |
|
||||
||| **mlp.down_proj.max_weights.3** | 3: 0.86 |
|
||||
||| **mlp.down_proj.max_weight_position** | 28.60 |
|
||||
||| **mlp.down_proj.min_weights.0** | 0: 0.37 |
|
||||
||| **mlp.down_proj.min_weights.1** | 1: 0.25 |
|
||||
||| **mlp.down_proj.min_weights.2** | 2: 1.01 |
|
||||
||| **mlp.down_proj.min_weights.3** | 3: 0.45 |
|
||||
||| **mlp.down_proj.min_weight_distance** | 5.96 |
|
||||
|
||||
---
|
||||
## Degree of Heretication
|
||||
The **Heresy Index** weighs the resulting model's corruption by the process (KL Divergence & PIQA, Manual Response Eval) and its abolition of doctrine (Refusals) for a final verdict in classification.
|
||||
|
||||
| Index Entry | Classification | Analysis |
|
||||
| :--- | :--- | :--- |
|
||||
|  | **Absolute Heresy** | Near zero overt and secondary refusals with minimal to no model damage |
|
||||
|  | **Tainted Heresy** | Some residual secondary refusals and/or moderate model damage |
|
||||
|  | **Impotent Heresy** | Lingering overt refusals and high model damage |
|
||||
|
||||
**Note**: This is an arbitrary and subjective classification inspired by Warhammer 40K, indended to serve as a signpost towards the model's performance.
|
||||
|
||||
---
|
||||
**Appendix**
|
||||
|
||||
> Empty system prompt.
|
||||
|
||||
<details>
|
||||
<summary>Heretication Rituals</summary>
|
||||
|
||||
```
|
||||
» [Trial 93] Refusals: 3/416, KL divergence: 0.0182
|
||||
[Trial 159] Refusals: 4/416, KL divergence: 0.0141
|
||||
[Trial 80] Refusals: 9/416, KL divergence: 0.0140
|
||||
[Trial 174] Refusals: 10/416, KL divergence: 0.0140
|
||||
[Trial 163] Refusals: 12/416, KL divergence: 0.0132
|
||||
[Trial 118] Refusals: 15/416, KL divergence: 0.0121
|
||||
[Trial 82] Refusals: 18/416, KL divergence: 0.0099
|
||||
[Trial 169] Refusals: 22/416, KL divergence: 0.0095
|
||||
[Trial 119] Refusals: 35/416, KL divergence: 0.0091
|
||||
[Trial 96] Refusals: 40/416, KL divergence: 0.0084
|
||||
[Trial 100] Refusals: 45/416, KL divergence: 0.0067
|
||||
[Trial 109] Refusals: 67/416, KL divergence: 0.0066
|
||||
[Trial 62] Refusals: 155/416, KL divergence: 0.0065
|
||||
[Trial 151] Refusals: 157/416, KL divergence: 0.0065
|
||||
[Trial 164] Refusals: 168/416, KL divergence: 0.0060
|
||||
[Trial 127] Refusals: 195/416, KL divergence: 0.0048
|
||||
[Trial 139] Refusals: 263/416, KL divergence: 0.0041
|
||||
[Trial 32] Refusals: 267/416, KL divergence: 0.0030
|
||||
[Trial 101] Refusals: 313/416, KL divergence: 0.0016
|
||||
[Trial 63] Refusals: 317/416, KL divergence: 0.0015
|
||||
[Trial 181] Refusals: 330/416, KL divergence: 0.0014
|
||||
[Trial 13] Refusals: 332/416, KL divergence: 0.0014
|
||||
[Trial 59] Refusals: 333/416, KL divergence: 0.0011
|
||||
[Trial 54] Refusals: 339/416, KL divergence: 0.0008
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
<details>
|
||||
<summary>PIQA Benchmarks</summary>
|
||||
|
||||
```
|
||||
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
|
||||
┃ Benchmark ┃ Metric ┃ Value ┃
|
||||
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
|
||||
│ PIQA Base │ acc,none │ 0.7900 │
|
||||
│ │ acc_stderr,none │ 0.0095 │
|
||||
│ │ acc_norm,none │ 0.8020 │
|
||||
│ │ acc_norm_stderr,none │ 0.0093 │
|
||||
└───────────┴──────────────────────┴────────┘
|
||||
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
|
||||
┃ Benchmark ┃ Metric ┃ Value ┃
|
||||
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
|
||||
│ PIQA T93 │ acc,none │ 0.7900 │
|
||||
│ │ acc_stderr,none │ 0.0095 │
|
||||
│ │ acc_norm,none │ 0.8030 │
|
||||
│ │ acc_norm_stderr,none │ 0.0093 │
|
||||
└───────────┴──────────────────────┴────────┘
|
||||
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
|
||||
┃ Benchmark ┃ Metric ┃ Value ┃
|
||||
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
|
||||
│ PIQA T159 │ acc,none │ 0.7878 │
|
||||
│ │ acc_stderr,none │ 0.0095 │
|
||||
│ │ acc_norm,none │ 0.8047 │
|
||||
│ │ acc_norm_stderr,none │ 0.0092 │
|
||||
└───────────┴──────────────────────┴────────┘
|
||||
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
|
||||
┃ Benchmark ┃ Metric ┃ Value ┃
|
||||
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
|
||||
│ PIQA T163 │ acc,none │ 0.7884 │
|
||||
│ │ acc_stderr,none │ 0.0095 │
|
||||
│ │ acc_norm,none │ 0.8036 │
|
||||
│ │ acc_norm_stderr,none │ 0.0093 │
|
||||
└───────────┴──────────────────────┴────────┘
|
||||
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
|
||||
┃ Benchmark ┃ Metric ┃ Value ┃
|
||||
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
|
||||
│ PIQA T80 │ acc,none │ 0.7884 │
|
||||
│ │ acc_stderr,none │ 0.0095 │
|
||||
│ │ acc_norm,none │ 0.8020 │
|
||||
│ │ acc_norm_stderr,none │ 0.0093 │
|
||||
└───────────┴──────────────────────┴────────┘
|
||||
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
|
||||
┃ Benchmark ┃ Metric ┃ Value ┃
|
||||
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
|
||||
│ PIQA T174 │ acc,none │ 0.7889 │
|
||||
│ │ acc_stderr,none │ 0.0095 │
|
||||
│ │ acc_norm,none │ 0.8014 │
|
||||
│ │ acc_norm_stderr,none │ 0.0093 │
|
||||
└───────────┴──────────────────────┴────────┘
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
---
|
||||
Mistral v3 Tekken or Metharme.
|
||||
|
||||
Can think via \<thinking\> or \<think\>
|
||||
|
||||
Just like Roci X but better.
|
||||
|
||||
(Model card still a WIP)
|
||||
|
||||
FP16: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1
|
||||
GGUF: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1-GGUF
|
||||
3
Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf
Normal file
3
Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:df8b80545d5fdf9adb7719f31ed19ff8a7b008f0993631f62e47c416fabf2ecd
|
||||
size 32138494144
|
||||
3
Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf
Normal file
3
Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ccf6b42e5a1563337437401ca0738363d2b85f6ef5384f75b681a5943c10abad
|
||||
size 9746399424
|
||||
3
Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf
Normal file
3
Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0e9e689347fc665ae7fe255aaf791fd11c5c5c242c0f0a062972cc55c9d64ed6
|
||||
size 13187776704
|
||||
3
Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf
Normal file
3
Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8017daec5aebe22b511cddde84c43691e5eb709912cb41acad5b8219e8e92886
|
||||
size 17078321344
|
||||
Reference in New Issue
Block a user