MuXodious/Goetia-24B-v1.3-absolute-heresy
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
Goetia-24B-v1.3-absolute-he…/README.md
ModelHub XC 761c167831 初始化项目，由ModelHub XC社区提供模型 
Model: MuXodious/Goetia-24B-v1.3-absolute-heresy
Source: Original Platform
2026-10-06 07:01:17 +08:00

8.7 KiB
Raw Permalink Blame History

base_model, datasets, language, library_name, license, tags, widget
base_model datasets language library_name license tags widget
Naphula/Goetia-24B-v1.3
OccultAI/illuminati_imatrix_v1
en
transformers apache-2.0
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
float32
swearing
rp
horror
della
mistral
merge
mergekit
heretic
uncensored
decensored
abliterated
text output
Goetia-24B-v1.3
url
https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/DHbuh4efzjCGpxDUciZ_-.jpeg

This is a Goetia-24B-v1.3 fine-tune, produced at the request of redaihf through P-E-W's Heretic (v1.2.0) abliteration engine with Magnitude-Preserving Orthogonal Ablation enabled.

Note: An optimal KDL/Refusal ratio was preferred.

Heretication Results

Score Metric Value Parameter Value
Refusals 4/100 direction_index per layer
KL Divergence 0.0304 attn.o_proj.max_weight 0.86
Initial Refusals 91/100 attn.o_proj.max_weight_position 24.81
attn.o_proj.min_weight 0.71
attn.o_proj.min_weight_distance 12.72
mlp.down_proj.max_weight 2.40
mlp.down_proj.max_weight_position 25.57
mlp.down_proj.min_weight 1.22
mlp.down_proj.min_weight_distance 10.35

Degree of Heretication

The Heresy Index weighs the resulting model's corruption by the process (KL Divergence) and its abolition of doctrine (Refusals) for a final verdict in classification.

Index Entry Classification Analysis
Absolute Absolute Heresy Less than 10/100 Refusals and 0.10 KL Divergence
Tainted Tainted Heresy Around 25-11/100 Refusals and/or -0.20-0.11 KL Divergence
Impotent Impotent Heresy Anything above 25/100 Refusals and 0.21 KL Divergence

Note: This is an arbitrary classification inspired by Warhammer 40K, having no tangible indication towards the model's performance.

📜 Goetia 24B v1.3

Goetia

The "Della Edition" meant to test bridging 2501 and 2503 models. See this post and this other post for more info.

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Methods

This model was merged using the following merge method:

architecture: MistralForCausalLM
models:
  - model: B:\24B\!models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only
  - model: B:\24B\!models--TheDrummer--Cydonia-24B-v4.3
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!models--ReadyArt--4.2.0-Broken-Tutu-24b
    parameters:
      density: 0.8
      weight: 0.05
      epsilon: 0.1
  - model: B:\24B\!models--zerofata--MS3.2-PaintedFantasy-v2-24B
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!models--TheDrummer--Magidonia-24B-v4.3
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!models--TheDrummer--Precog-24B-v1
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!models--zerofata--MS3.2-PaintedFantasy-v3-24B
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!models--ReadyArt--Broken-Tutu-24B-Transgression-v2.0
    parameters:
      density: 0.8
      weight: 0.05
      epsilon: 0.1
  - model: B:\24B\!models--trashpanda-org--MS3.2-24B-Mullein-v2
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  # - model: B:\24B\!models--LatitudeGames--Hearthfire-24B
  #   parameters:
  #     density: 0.8
  #     weight: 0.1
  #     epsilon: 0.1
  - model: B:\24B\!models--TheDrummer--Cydonia-24B-v4.2.0
    parameters:
      density: 0.8
      weight: 0.1
      epsilon: 0.1
  - model: B:\24B\!models--TheDrummer--Magidonia-24B-v4.2.0
    parameters:
      density: 0.8
      weight: 0.1
      epsilon: 0.1
  - model: B:\24B\!models--ConicCat--Mistral-Small-3.2-AntiRep-24B
    parameters:
      density: 0.8
      weight: 0.15
      epsilon: 0.1
  - model: B:\24B\!models--Undi95--MistralThinker-v1.1
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--CrucibleLab--M3.2-24B-Loki-V2
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--Darkhn--M3.2-24B-Animus-V7.1
    parameters:
      density: 0.8
      weight: 0.1
      epsilon: 0.1
  - model: B:\24B\Morax-24B-v1
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--FlareRebellion--WeirdCompound-v1.7-24b
    parameters:
      density: 0.8
      weight: 0.1
      epsilon: 0.1
  # - model: B:\24B\!models--aixonlab--Eurydice-24b-v3.5
  #   parameters:
  #     density: 0.8
  #     weight: 0.08
  #     epsilon: 0.1
  - model: B:\24B\!models--allura-forge--ms32-final-TEXTONLY
    parameters:
      density: 0.8
      weight: 0.15
      epsilon: 0.1
  - model: B:\24B\!models--Delta-Vector--Rei-24B-KTO
    parameters:
      density: 0.8
      weight: 0.15
      epsilon: 0.1
  - model: B:\24B\!models--Doctor-Shotgun--MS3.2-24B-Magnum-Diamond
    parameters:
      density: 0.8
      weight: 0.15
      epsilon: 0.1
  - model: B:\24B\!models--ReadyArt--MS3.2-The-Omega-Directive-24B-Unslop-v2.1
    parameters:
     density: 0.8
     weight: 0.15
     epsilon: 0.1
  # - model: B:\24B\!models--Gryphe--Codex-24B-Small-3.2
  #   parameters:
  #    density: 0.8
  #    weight: 0.1
  #    epsilon: 0.1
  # - model: B:\24B\!models--CrucibleLab--M3.2-24B-Loki-V1.3
  #   parameters:
  #     density: 0.8
  #     weight: 0.15
  #     epsilon: 0.1
  - model: B:\24B\!models--arcee-ai--Arcee-Blitz
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--ArliAI--Mistral-Small-24B-ArliAI-RPMax-v1.4
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  # - model: B:\24B\!models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b
  #   parameters:
  #     density: 0.8
  #     weight: 0.1
  #     epsilon: 0.1
  - model: B:\24B\!models--ReadyArt--Dark-Nexus-24B-v2.0
    parameters:
      density: 0.8
      weight: 0.2
      epsilon: 0.1
  - model: B:\24B\!models--Darkhn--M3.2-24B-Animus-V5.1-Pro
    parameters:
      density: 0.8
      weight: 0.15
      epsilon: 0.1
  - model: B:\24B\!models--dphn--Dolphin-Mistral-24B-Venice-Edition
    parameters:
      density: 0.8
      weight: 0.01
      epsilon: 0.1
  - model: B:\24B\!models--TroyDoesAI--BlackSheep-24B
    parameters:
      density: 0.8
      weight: 0.01
      epsilon: 0.1
  - model: B:\24B\!models--TheDrummer--Cydonia-24B-v2
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--PocketDoc--Dans-DangerousWinds-V1.1.1-24b
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--trashpanda-org--MS-24B-Instruct-Mullein-v0
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
  - model: B:\24B\!models--OddTheGreat--Circuitry_24B_V.3
    parameters:
      density: 0.8
      weight: 0.1
      epsilon: 0.1
  - model: B:\24B\!models--spacewars123--Space-Wars-24B-v1.00a
    parameters:
      density: 0.8
      weight: 0.02
      epsilon: 0.1
# Total Donors: 33
# Total Weights: 3.3
# Seed: 420 
merge_method: della
base_model: B:\24B\!models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only
parameters:
  lambda: 1.0
  normalize: true # key variable to test
  int8_mask: false
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: base
# chat_template: auto
name: 📜 Goetia-24B-v1.3