base_model, library_name, tags

base_model	library_name	tags
TheDrummer/Magidonia-24B-v4.3 Ateron/Sketch-Cydonia OddTheGreat/Rotor_24B_V.1 DarkArtsForge/Magistaroth-24B-v1.1 MrRikyz/Rei-Pulse-24B sophosympatheia/Magistry-24B-v1.0 TheDrummer/Cydonia-24B-v4.3	transformers	mergekit merge RP NSFW roleplay

FusionPulse-24B

---

🌟 Overview

FusionPulse-24B is a merge built on top of Magidonia-24B-v4.3.

The model uses the TIES method

🧩 Models Merged

This model results from a merge between:

• TheDrummer/Magidonia-24B-v4.3 (Base)
• Ateron/Sketch-Cydonia
• OddTheGreat/Rotor_24B_V.1
• DarkArtsForge/Magistaroth-24B-v1.1
• MrRikyz/Rei-Pulse-24B
• sophosympatheia/Magistry-24B-v1.0
• TheDrummer/Cydonia-24B-v4.3

---

🛠️ Merge Details

Method: TIES

The merge was performed using mergekit with the following parameters:

• Base Model: TheDrummer/Magidonia-24B-v4.3
• Dtype: float32
• ODtype BFloat16
• tokenizer source base

⚙️ Configuration

View Full Mergekit YAML

base_model: TheDrummer/Magidonia-24B-v4.3
dtype: float32
merge_method: ties
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 40]
        model: Ateron/Sketch-Cydonia
        parameters:
          density: 0.55
          weight: 0.18
      - layer_range: [0, 40]
        model: OddTheGreat/Rotor_24B_V.1
        parameters:
          density: 0.65
          weight: 0.22
      - layer_range: [0, 40]
        model: DarkArtsForge/Magistaroth-24B-v1.1
        parameters:
          density: 0.7
          weight: 0.27
      - layer_range: [0, 40]
        model: MrRikyz/Rei-Pulse-24B
        parameters:
          density: 0.6
          weight: 0.19
      - layer_range: [0, 40]
        model: sophosympatheia/Magistry-24B-v1.0
        parameters:
          density: 0.44
          weight: 0.23
      - layer_range: [0, 40]
        model: TheDrummer/Cydonia-24B-v4.3
        parameters:
          density: 0.25
          weight: 0.18
      - layer_range: [0, 40]
        model: TheDrummer/Magidonia-24B-v4.3

base_model_alpha: 0.85

ties:
  merge_strategy: sum
  normalize: true
  sparsity: 0.17
  rescale: true

layer_wise:
  - filter: "layers.0-8.*"
    scale: 0.75
  - filter: "layers.9-20.*"
    scale: 1.05
  - filter: "layers.21-31.*"
    scale: 1.15

tensor_factors:
  attention: 1.1
  mlp: 1.2

post:
  normalize: true
  clamp: 2.5

out_dtype: bfloat16
tokenizer:
  source: base

✨ Acknowledgements

Thanks to the authors of the original models for their incredible work:

• Ateron for Sketch-Cydonia
• OddTheGreat for Rotor_24B_V.1
• DarkArtsForge for Magistaroth-24B-v1.1
• sophosympatheia for Magistry-24B-v1.0
• TheDrummer for Cydonia-24B-v4.3 and Magidonia-24B-v4.3