116 lines
3.4 KiB
Markdown
116 lines
3.4 KiB
Markdown
---
|
|
base_model:
|
|
- PygmalionAI/Pygmalion-3-12B
|
|
- PygmalionAI/Eleusis-12B
|
|
- SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated
|
|
- DreadPoor/Famino-12B-Model_Stock
|
|
- Vortex5/Azure-Starlight-12B
|
|
- MrRikyz/Foxfire_Bloom
|
|
- SicariusSicariiStuff/Impish_Bloodmoon_12B
|
|
library_name: transformers
|
|
tags:
|
|
- mergekit
|
|
- merge
|
|
- roleplay
|
|
- rp
|
|
- nsfw
|
|
- model_stock
|
|
language:
|
|
- en
|
|
---
|
|
|
|
<div style="width: 100%; text-align: center; padding: 40px 20px; background: radial-gradient(circle, rgba(43,0,72,0.05) 0%, rgba(10,10,35,0.02) 100%); border-radius: 20px; margin-bottom: 30px; border: 1px solid rgba(106, 17, 203, 0.1);">
|
|
<h1 style="font-size: 3.5em; font-weight: 900; background: linear-gradient(135deg, #b19cd9 0%, #6a11cb 25%, #2575fc 70%, #33ccff 100%); -webkit-background-clip: text; -webkit-text-fill-color: transparent; filter: drop-shadow(0px 0px 12px rgba(106, 17, 203, 0.4)); margin: 0; padding: 10px 0;">
|
|
StarlightMoon-Foxfire-12B
|
|
</h1>
|
|
<p style="font-size: 1.4em; color: #5d5d81; font-family: 'Georgia', serif; font-style: italic; margin-top: 10px; letter-spacing: 2px;">
|
|
A blend of 12B Roleplay models
|
|
</p>
|
|
<div style="width: 60%; height: 2px; background: linear-gradient(to right, transparent, #6a11cb, #33ccff, transparent); margin: 25px auto;"></div>
|
|
</div>
|
|
|
|
## 🌟 Overview
|
|
|
|
**StarlightMoon-Foxfire-12B** is a merge built on top of `Impish_Bloodmoon_12B` by `SicariusSicariiStuff`.
|
|
|
|
The model uses the **model_stock** method
|
|
|
|
### 🧩 Models Merged
|
|
|
|
This model results from a merge between:
|
|
|
|
* **SicariusSicariiStuff/Impish_Bloodmoon_12B** (Base)
|
|
* **SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated**
|
|
* **DreadPoor/Famino-12B-Model_Stock**
|
|
* **PygmalionAI/Eleusis-12B**
|
|
* **PygmalionAI/Pygmalion-3-12B**
|
|
* **MrRikyz/Foxfire_Bloom**
|
|
* **Vortex5/Azure-Starlight-12B**
|
|
|
|
---
|
|
|
|
## 🛠️ Merge Details
|
|
|
|
### Method: MODEL_STOCK
|
|
The merge was performed using `mergekit` with the following parameters:
|
|
- **Base Model:** Impish_Bloodmoon_12B_Abliterated
|
|
- **Dtype:** Float32
|
|
- **Out_Dtype** BFloat16
|
|
- **lambda:** 0.82
|
|
|
|
---
|
|
|
|
<details>
|
|
<summary><b>View Merge Configuration (YAML)</b></summary>
|
|
|
|
```yaml
|
|
base_model: SicariusSicariiStuff/Impish_Bloodmoon_12B
|
|
dtype: float32
|
|
merge_method: model_stock
|
|
modules:
|
|
default:
|
|
slices:
|
|
- sources:
|
|
- layer_range: [0, 40]
|
|
model: SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated
|
|
parameters:
|
|
weight: 0.54
|
|
- layer_range: [0, 40]
|
|
model: DreadPoor/Famino-12B-Model_Stock
|
|
parameters:
|
|
weight: 0.38
|
|
- layer_range: [0, 40]
|
|
model: PygmalionAI/Eleusis-12B
|
|
parameters:
|
|
weight: 0.12
|
|
- layer_range: [0, 40]
|
|
model: PygmalionAI/Pygmalion-3-12B
|
|
parameters:
|
|
weight: 0.12
|
|
- layer_range: [0, 40]
|
|
model: MrRikyz/Foxfire_Bloom
|
|
parameters:
|
|
weight: 0.22
|
|
- layer_range: [0, 40]
|
|
model: Vortex5/Azure-Starlight-12B
|
|
parameters:
|
|
weight: 0.1
|
|
- layer_range: [0, 40]
|
|
model: SicariusSicariiStuff/Impish_Bloodmoon_12B
|
|
out_dtype: bfloat16
|
|
parameters:
|
|
lambda: 0.82
|
|
normalize: 1.0
|
|
tokenizer:
|
|
source: MrRikyz/Foxfire_Bloom
|
|
```
|
|
</details>
|
|
|
|
# ✨ Acknowledgements
|
|
|
|
Thanks to the authors of the original models for their incredible work:
|
|
|
|
- SicariusSicariiStuff for `Impish_Bloodmoon_12B` and `Impish_Bloodmoon_12B_Abliterated`
|
|
- DreadPoor for `Famino-12B-Model_Stock`
|
|
- PygmalionAI for `Eleusis-12B` and `PygmalionAI/Pygmalion-3-12B`
|
|
- Vortex5 for `Azure-Starlight-12B` |