commit 3af47b6364dcbbc174c8d78fada3af46da45301b Author: ModelHub XC Date: Sat Jun 20 22:03:21 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: MuXodious/Rocinante-XL-16B-v1-absolute-heresy-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..3240f70 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf filter=lfs diff=lfs merge=lfs -text +Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..978e890 --- /dev/null +++ b/README.md @@ -0,0 +1,164 @@ +--- +tags: +- heretic +- uncensored +- decensored +- abliterated +base_model: +- MuXodious/Rocinante-XL-16B-v1-absolute-heresy +pipeline_tag: text-generation +--- +Static GGUF quants of Rocinante-XL-16B-v1-absolute-heresy. + +--- +This is a **Rocinante-XL-16B-v1** fine-tune, produced through P-E-W's [Heretic](https://github.com/p-e-w/heretic) (v1.2.0) abliteration engine with [Self-Organizing Maps & Magnitude-Preserving Orthogonal Ablation](https://github.com/p-e-w/heretic/pull/196) enabled. + +--- +

+ Heretication Results + +
+ +

+
+ +| Score Metric | Value | Parameter | Value | +| :--- | :--- | :--- | :--- | +| **Refusals** | 3/416 | **direction_index** | 22.20 | +| **KL Divergence** | 0.0182 | **attn.o_proj.max_weights.0** | 0: 1.26 | +| **Initial Refusals** | 339/416 | **attn.o_proj.max_weights.1** | 1: 0.64 | +||| **attn.o_proj.max_weights.2** | 2: 1.41 | +||| **attn.o_proj.max_weights.3** | 3: 0.94 | +||| **attn.o_proj.max_weight_position** | 23.86 | +||| **attn.o_proj.min_weights.0** | 0: 0.97 | +||| **attn.o_proj.min_weights.1** | 1: 0.03 | +||| **attn.o_proj.min_weights.2** | 2: 1.18 | +||| **attn.o_proj.min_weights.3** | 3: 0.93 | +||| **attn.o_proj.min_weight_distance** | 18.57 | +||| **mlp.down_proj.max_weights.0** | 0: 1.23 | +||| **mlp.down_proj.max_weights.1** | 1: 0.70 | +||| **mlp.down_proj.max_weights.2** | 2: 1.35 | +||| **mlp.down_proj.max_weights.3** | 3: 0.86 | +||| **mlp.down_proj.max_weight_position** | 28.60 | +||| **mlp.down_proj.min_weights.0** | 0: 0.37 | +||| **mlp.down_proj.min_weights.1** | 1: 0.25 | +||| **mlp.down_proj.min_weights.2** | 2: 1.01 | +||| **mlp.down_proj.min_weights.3** | 3: 0.45 | +||| **mlp.down_proj.min_weight_distance** | 5.96 | + +--- +## Degree of Heretication +The **Heresy Index** weighs the resulting model's corruption by the process (KL Divergence & PIQA, Manual Response Eval) and its abolition of doctrine (Refusals) for a final verdict in classification. + +| Index Entry | Classification | Analysis | +| :--- | :--- | :--- | +| ![Absolute](https://img.shields.io/badge/HERESY_INDEX-ABSOLUTE-white?style=flat-square&labelColor=101010) | **Absolute Heresy** | Near zero overt and secondary refusals with minimal to no model damage | +| ![Tainted](https://img.shields.io/badge/HERESY_INDEX-TAINTED-blueviolet?style=flat-square&labelColor=101010) | **Tainted Heresy** | Some residual secondary refusals and/or moderate model damage | +| ![Impotent](https://img.shields.io/badge/HERESY_INDEX-IMPOTENT-5c4033?style=flat-square&labelColor=101010) | **Impotent Heresy** | Lingering overt refusals and high model damage | + +**Note**: This is an arbitrary and subjective classification inspired by Warhammer 40K, indended to serve as a signpost towards the model's performance. + +--- +**Appendix** + +> Empty system prompt. + +
+ Heretication Rituals + +``` + » [Trial 93] Refusals: 3/416, KL divergence: 0.0182 + [Trial 159] Refusals: 4/416, KL divergence: 0.0141 + [Trial 80] Refusals: 9/416, KL divergence: 0.0140 + [Trial 174] Refusals: 10/416, KL divergence: 0.0140 + [Trial 163] Refusals: 12/416, KL divergence: 0.0132 + [Trial 118] Refusals: 15/416, KL divergence: 0.0121 + [Trial 82] Refusals: 18/416, KL divergence: 0.0099 + [Trial 169] Refusals: 22/416, KL divergence: 0.0095 + [Trial 119] Refusals: 35/416, KL divergence: 0.0091 + [Trial 96] Refusals: 40/416, KL divergence: 0.0084 + [Trial 100] Refusals: 45/416, KL divergence: 0.0067 + [Trial 109] Refusals: 67/416, KL divergence: 0.0066 + [Trial 62] Refusals: 155/416, KL divergence: 0.0065 + [Trial 151] Refusals: 157/416, KL divergence: 0.0065 + [Trial 164] Refusals: 168/416, KL divergence: 0.0060 + [Trial 127] Refusals: 195/416, KL divergence: 0.0048 + [Trial 139] Refusals: 263/416, KL divergence: 0.0041 + [Trial 32] Refusals: 267/416, KL divergence: 0.0030 + [Trial 101] Refusals: 313/416, KL divergence: 0.0016 + [Trial 63] Refusals: 317/416, KL divergence: 0.0015 + [Trial 181] Refusals: 330/416, KL divergence: 0.0014 + [Trial 13] Refusals: 332/416, KL divergence: 0.0014 + [Trial 59] Refusals: 333/416, KL divergence: 0.0011 + [Trial 54] Refusals: 339/416, KL divergence: 0.0008 +``` + +
+ +
+ PIQA Benchmarks + +``` +┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ +┃ Benchmark ┃ Metric ┃ Value ┃ +┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ +│ PIQA Base │ acc,none │ 0.7900 │ +│ │ acc_stderr,none │ 0.0095 │ +│ │ acc_norm,none │ 0.8020 │ +│ │ acc_norm_stderr,none │ 0.0093 │ +└───────────┴──────────────────────┴────────┘ +┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ +┃ Benchmark ┃ Metric ┃ Value ┃ +┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ +│ PIQA T93 │ acc,none │ 0.7900 │ +│ │ acc_stderr,none │ 0.0095 │ +│ │ acc_norm,none │ 0.8030 │ +│ │ acc_norm_stderr,none │ 0.0093 │ +└───────────┴──────────────────────┴────────┘ +┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ +┃ Benchmark ┃ Metric ┃ Value ┃ +┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ +│ PIQA T159 │ acc,none │ 0.7878 │ +│ │ acc_stderr,none │ 0.0095 │ +│ │ acc_norm,none │ 0.8047 │ +│ │ acc_norm_stderr,none │ 0.0092 │ +└───────────┴──────────────────────┴────────┘ +┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ +┃ Benchmark ┃ Metric ┃ Value ┃ +┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ +│ PIQA T163 │ acc,none │ 0.7884 │ +│ │ acc_stderr,none │ 0.0095 │ +│ │ acc_norm,none │ 0.8036 │ +│ │ acc_norm_stderr,none │ 0.0093 │ +└───────────┴──────────────────────┴────────┘ +┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ +┃ Benchmark ┃ Metric ┃ Value ┃ +┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ +│ PIQA T80 │ acc,none │ 0.7884 │ +│ │ acc_stderr,none │ 0.0095 │ +│ │ acc_norm,none │ 0.8020 │ +│ │ acc_norm_stderr,none │ 0.0093 │ +└───────────┴──────────────────────┴────────┘ +┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ +┃ Benchmark ┃ Metric ┃ Value ┃ +┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ +│ PIQA T174 │ acc,none │ 0.7889 │ +│ │ acc_stderr,none │ 0.0095 │ +│ │ acc_norm,none │ 0.8014 │ +│ │ acc_norm_stderr,none │ 0.0093 │ +└───────────┴──────────────────────┴────────┘ +``` + +
+ +--- +Mistral v3 Tekken or Metharme. + +Can think via \ or \ + +Just like Roci X but better. + +(Model card still a WIP) + +FP16: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1 +GGUF: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1-GGUF \ No newline at end of file diff --git a/Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf b/Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf new file mode 100644 index 0000000..d844240 --- /dev/null +++ b/Rocinante-XL-16B-absolute-heresy-v1-BF16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df8b80545d5fdf9adb7719f31ed19ff8a7b008f0993631f62e47c416fabf2ecd +size 32138494144 diff --git a/Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf b/Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf new file mode 100644 index 0000000..c989fa7 --- /dev/null +++ b/Rocinante-XL-16B-absolute-heresy-v1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ccf6b42e5a1563337437401ca0738363d2b85f6ef5384f75b681a5943c10abad +size 9746399424 diff --git a/Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf b/Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf new file mode 100644 index 0000000..d1610f9 --- /dev/null +++ b/Rocinante-XL-16B-absolute-heresy-v1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e9e689347fc665ae7fe255aaf791fd11c5c5c242c0f0a062972cc55c9d64ed6 +size 13187776704 diff --git a/Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf b/Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf new file mode 100644 index 0000000..14d0fe2 --- /dev/null +++ b/Rocinante-XL-16B-absolute-heresy-v1-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8017daec5aebe22b511cddde84c43691e5eb709912cb41acad5b8219e8e92886 +size 17078321344