初始化项目，由ModelHub XC社区提供模型

Model: MuXodious/Goetia-24B-v1.3-absolute-heresy Source: Original Platform
2026-10-06 07:01:17 +08:00
commit 761c167831
19 changed files with 10873 additions and 0 deletions
--- a/README.md
+++ b/README.md
@@ -0,0 +1,299 @@
+---
+base_model:
+- Naphula/Goetia-24B-v1.3
+datasets:
+- OccultAI/illuminati_imatrix_v1
+language:
+- en
+library_name: transformers
+license: apache-2.0
+tags:
+- creative
+- creative writing
+- fiction writing
+- plot generation
+- sub-plot generation
+- story generation
+- scene continue
+- storytelling
+- fiction story
+- science fiction
+- romance
+- all genres
+- story
+- writing
+- vivid prosing
+- vivid writing
+- fiction
+- roleplaying
+- float32
+- swearing
+- rp
+- horror
+- della
+- mistral
+- merge
+- mergekit
+- heretic
+- uncensored
+- decensored
+- abliterated
+widget:
+- text: Goetia-24B-v1.3
+  output:
+    url: https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/DHbuh4efzjCGpxDUciZ_-.jpeg
+---
+This is a **Goetia-24B-v1.3** fine-tune, produced at the request of [redaihf](https://huggingface.co/redaihf) through P-E-W's [Heretic](https://github.com/p-e-w/heretic) (v1.2.0) abliteration engine with [Magnitude-Preserving Orthogonal Ablation](https://github.com/p-e-w/heretic/pull/52) enabled.
+
+**Note:** An optimal KDL/Refusal ratio was preferred.
+
+---
+<img src="https://img.shields.io/badge/HERESY_INDEX-ABSOLUTE-white?style=flat-square&labelColor=101010" align="right" width="250">
+
+
+**Heretication Results**
+
+| Score Metric | Value | Parameter | Value |
+| :--- | :--- | :--- | :--- |
+| **Refusals** | 4/100 | **direction_index** |  per layer  |
+| **KL Divergence** | 0.0304  | **attn.o_proj.max_weight** | 0.86  |
+| **Initial Refusals** | 91/100 | **attn.o_proj.max_weight_position** | 24.81 |
+||| **attn.o_proj.min_weight** | 0.71 |
+||| **attn.o_proj.min_weight_distance** | 12.72 |
+||| **mlp.down_proj.max_weight** | 2.40 |
+||| **mlp.down_proj.max_weight_position** | 25.57 |
+||| **mlp.down_proj.min_weight** | 1.22 |
+||| **mlp.down_proj.min_weight_distance** | 10.35 |
+
+---
+## Degree of Heretication
+The **Heresy Index** weighs the resulting model's corruption by the process (KL Divergence) and its abolition of doctrine (Refusals) for a final verdict in classification.
+
+| Index Entry | Classification | Analysis |
+| :--- | :--- | :--- |
+| ![Absolute](https://img.shields.io/badge/HERESY_INDEX-ABSOLUTE-white?style=flat-square&labelColor=101010) | **Absolute Heresy** | Less than 10/100 Refusals and 0.10 KL Divergence |
+| ![Tainted](https://img.shields.io/badge/HERESY_INDEX-TAINTED-blueviolet?style=flat-square&labelColor=101010) | **Tainted Heresy** | Around 25-11/100 Refusals and/or -0.20-0.11 KL Divergence |
+| ![Impotent](https://img.shields.io/badge/HERESY_INDEX-IMPOTENT-5c4033?style=flat-square&labelColor=101010) | **Impotent Heresy** | Anything above 25/100 Refusals and 0.21 KL Divergence |
+
+**Note**: This is an arbitrary classification inspired by Warhammer 40K, having no tangible indication towards the model's performance.
+
+---
+# 📜 Goetia 24B v1.3
+
+![Goetia](https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/DHbuh4efzjCGpxDUciZ_-.jpeg)
+
+The "Della Edition" meant to test bridging 2501 and 2503 models. See [this post](https://huggingface.co/Naphula/Goetia-24B-v1.3/discussions/1) and [this other post](https://huggingface.co/Naphula/Q0_Bench/discussions/1?not-for-all-audiences=true#6987717c762f0a45f672e250) for more info.
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Methods
+
+This model was merged using the following merge method:
+- [DELLA](https://arxiv.org/abs/2406.11617)
+
+```yaml
+architecture: MistralForCausalLM
+models:
+  - model: B:\24B\!models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only
+  - model: B:\24B\!models--TheDrummer--Cydonia-24B-v4.3
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!models--ReadyArt--4.2.0-Broken-Tutu-24b
+    parameters:
+      density: 0.8
+      weight: 0.05
+      epsilon: 0.1
+  - model: B:\24B\!models--zerofata--MS3.2-PaintedFantasy-v2-24B
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!models--TheDrummer--Magidonia-24B-v4.3
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!models--TheDrummer--Precog-24B-v1
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!models--zerofata--MS3.2-PaintedFantasy-v3-24B
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!models--ReadyArt--Broken-Tutu-24B-Transgression-v2.0
+    parameters:
+      density: 0.8
+      weight: 0.05
+      epsilon: 0.1
+  - model: B:\24B\!models--trashpanda-org--MS3.2-24B-Mullein-v2
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  # - model: B:\24B\!models--LatitudeGames--Hearthfire-24B
+  #   parameters:
+  #     density: 0.8
+  #     weight: 0.1
+  #     epsilon: 0.1
+  - model: B:\24B\!models--TheDrummer--Cydonia-24B-v4.2.0
+    parameters:
+      density: 0.8
+      weight: 0.1
+      epsilon: 0.1
+  - model: B:\24B\!models--TheDrummer--Magidonia-24B-v4.2.0
+    parameters:
+      density: 0.8
+      weight: 0.1
+      epsilon: 0.1
+  - model: B:\24B\!models--ConicCat--Mistral-Small-3.2-AntiRep-24B
+    parameters:
+      density: 0.8
+      weight: 0.15
+      epsilon: 0.1
+  - model: B:\24B\!models--Undi95--MistralThinker-v1.1
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--CrucibleLab--M3.2-24B-Loki-V2
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--Darkhn--M3.2-24B-Animus-V7.1
+    parameters:
+      density: 0.8
+      weight: 0.1
+      epsilon: 0.1
+  - model: B:\24B\Morax-24B-v1
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--FlareRebellion--WeirdCompound-v1.7-24b
+    parameters:
+      density: 0.8
+      weight: 0.1
+      epsilon: 0.1
+  # - model: B:\24B\!models--aixonlab--Eurydice-24b-v3.5
+  #   parameters:
+  #     density: 0.8
+  #     weight: 0.08
+  #     epsilon: 0.1
+  - model: B:\24B\!models--allura-forge--ms32-final-TEXTONLY
+    parameters:
+      density: 0.8
+      weight: 0.15
+      epsilon: 0.1
+  - model: B:\24B\!models--Delta-Vector--Rei-24B-KTO
+    parameters:
+      density: 0.8
+      weight: 0.15
+      epsilon: 0.1
+  - model: B:\24B\!models--Doctor-Shotgun--MS3.2-24B-Magnum-Diamond
+    parameters:
+      density: 0.8
+      weight: 0.15
+      epsilon: 0.1
+  - model: B:\24B\!models--ReadyArt--MS3.2-The-Omega-Directive-24B-Unslop-v2.1
+    parameters:
+     density: 0.8
+     weight: 0.15
+     epsilon: 0.1
+  # - model: B:\24B\!models--Gryphe--Codex-24B-Small-3.2
+  #   parameters:
+  #    density: 0.8
+  #    weight: 0.1
+  #    epsilon: 0.1
+  # - model: B:\24B\!models--CrucibleLab--M3.2-24B-Loki-V1.3
+  #   parameters:
+  #     density: 0.8
+  #     weight: 0.15
+  #     epsilon: 0.1
+  - model: B:\24B\!models--arcee-ai--Arcee-Blitz
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--ArliAI--Mistral-Small-24B-ArliAI-RPMax-v1.4
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  # - model: B:\24B\!models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b
+  #   parameters:
+  #     density: 0.8
+  #     weight: 0.1
+  #     epsilon: 0.1
+  - model: B:\24B\!models--ReadyArt--Dark-Nexus-24B-v2.0
+    parameters:
+      density: 0.8
+      weight: 0.2
+      epsilon: 0.1
+  - model: B:\24B\!models--Darkhn--M3.2-24B-Animus-V5.1-Pro
+    parameters:
+      density: 0.8
+      weight: 0.15
+      epsilon: 0.1
+  - model: B:\24B\!models--dphn--Dolphin-Mistral-24B-Venice-Edition
+    parameters:
+      density: 0.8
+      weight: 0.01
+      epsilon: 0.1
+  - model: B:\24B\!models--TroyDoesAI--BlackSheep-24B
+    parameters:
+      density: 0.8
+      weight: 0.01
+      epsilon: 0.1
+  - model: B:\24B\!models--TheDrummer--Cydonia-24B-v2
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--PocketDoc--Dans-DangerousWinds-V1.1.1-24b
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--trashpanda-org--MS-24B-Instruct-Mullein-v0
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+  - model: B:\24B\!models--OddTheGreat--Circuitry_24B_V.3
+    parameters:
+      density: 0.8
+      weight: 0.1
+      epsilon: 0.1
+  - model: B:\24B\!models--spacewars123--Space-Wars-24B-v1.00a
+    parameters:
+      density: 0.8
+      weight: 0.02
+      epsilon: 0.1
+# Total Donors: 33
+# Total Weights: 3.3
+# Seed: 420 
+merge_method: della
+base_model: B:\24B\!models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only
+parameters:
+  lambda: 1.0
+  normalize: true # key variable to test
+  int8_mask: false
+dtype: float32
+out_dtype: bfloat16
+tokenizer:
+  source: base
+# chat_template: auto
+name: 📜 Goetia-24B-v1.3
+```