初始化项目,由ModelHub XC社区提供模型
Model: MrRikyz/StarlightMoon-Foxfire-12B Source: Original Platform
This commit is contained in:
116
README.md
Normal file
116
README.md
Normal file
@@ -0,0 +1,116 @@
|
||||
---
|
||||
base_model:
|
||||
- PygmalionAI/Pygmalion-3-12B
|
||||
- PygmalionAI/Eleusis-12B
|
||||
- SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated
|
||||
- DreadPoor/Famino-12B-Model_Stock
|
||||
- Vortex5/Azure-Starlight-12B
|
||||
- MrRikyz/Foxfire_Bloom
|
||||
- SicariusSicariiStuff/Impish_Bloodmoon_12B
|
||||
library_name: transformers
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
- roleplay
|
||||
- rp
|
||||
- nsfw
|
||||
- model_stock
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
<div style="width: 100%; text-align: center; padding: 40px 20px; background: radial-gradient(circle, rgba(43,0,72,0.05) 0%, rgba(10,10,35,0.02) 100%); border-radius: 20px; margin-bottom: 30px; border: 1px solid rgba(106, 17, 203, 0.1);">
|
||||
<h1 style="font-size: 3.5em; font-weight: 900; background: linear-gradient(135deg, #b19cd9 0%, #6a11cb 25%, #2575fc 70%, #33ccff 100%); -webkit-background-clip: text; -webkit-text-fill-color: transparent; filter: drop-shadow(0px 0px 12px rgba(106, 17, 203, 0.4)); margin: 0; padding: 10px 0;">
|
||||
StarlightMoon-Foxfire-12B
|
||||
</h1>
|
||||
<p style="font-size: 1.4em; color: #5d5d81; font-family: 'Georgia', serif; font-style: italic; margin-top: 10px; letter-spacing: 2px;">
|
||||
A blend of 12B Roleplay models
|
||||
</p>
|
||||
<div style="width: 60%; height: 2px; background: linear-gradient(to right, transparent, #6a11cb, #33ccff, transparent); margin: 25px auto;"></div>
|
||||
</div>
|
||||
|
||||
## 🌟 Overview
|
||||
|
||||
**StarlightMoon-Foxfire-12B** is a merge built on top of `Impish_Bloodmoon_12B` by `SicariusSicariiStuff`.
|
||||
|
||||
The model uses the **model_stock** method
|
||||
|
||||
### 🧩 Models Merged
|
||||
|
||||
This model results from a merge between:
|
||||
|
||||
* **SicariusSicariiStuff/Impish_Bloodmoon_12B** (Base)
|
||||
* **SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated**
|
||||
* **DreadPoor/Famino-12B-Model_Stock**
|
||||
* **PygmalionAI/Eleusis-12B**
|
||||
* **PygmalionAI/Pygmalion-3-12B**
|
||||
* **MrRikyz/Foxfire_Bloom**
|
||||
* **Vortex5/Azure-Starlight-12B**
|
||||
|
||||
---
|
||||
|
||||
## 🛠️ Merge Details
|
||||
|
||||
### Method: MODEL_STOCK
|
||||
The merge was performed using `mergekit` with the following parameters:
|
||||
- **Base Model:** Impish_Bloodmoon_12B_Abliterated
|
||||
- **Dtype:** Float32
|
||||
- **Out_Dtype** BFloat16
|
||||
- **lambda:** 0.82
|
||||
|
||||
---
|
||||
|
||||
<details>
|
||||
<summary><b>View Merge Configuration (YAML)</b></summary>
|
||||
|
||||
```yaml
|
||||
base_model: SicariusSicariiStuff/Impish_Bloodmoon_12B
|
||||
dtype: float32
|
||||
merge_method: model_stock
|
||||
modules:
|
||||
default:
|
||||
slices:
|
||||
- sources:
|
||||
- layer_range: [0, 40]
|
||||
model: SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated
|
||||
parameters:
|
||||
weight: 0.54
|
||||
- layer_range: [0, 40]
|
||||
model: DreadPoor/Famino-12B-Model_Stock
|
||||
parameters:
|
||||
weight: 0.38
|
||||
- layer_range: [0, 40]
|
||||
model: PygmalionAI/Eleusis-12B
|
||||
parameters:
|
||||
weight: 0.12
|
||||
- layer_range: [0, 40]
|
||||
model: PygmalionAI/Pygmalion-3-12B
|
||||
parameters:
|
||||
weight: 0.12
|
||||
- layer_range: [0, 40]
|
||||
model: MrRikyz/Foxfire_Bloom
|
||||
parameters:
|
||||
weight: 0.22
|
||||
- layer_range: [0, 40]
|
||||
model: Vortex5/Azure-Starlight-12B
|
||||
parameters:
|
||||
weight: 0.1
|
||||
- layer_range: [0, 40]
|
||||
model: SicariusSicariiStuff/Impish_Bloodmoon_12B
|
||||
out_dtype: bfloat16
|
||||
parameters:
|
||||
lambda: 0.82
|
||||
normalize: 1.0
|
||||
tokenizer:
|
||||
source: MrRikyz/Foxfire_Bloom
|
||||
```
|
||||
</details>
|
||||
|
||||
# ✨ Acknowledgements
|
||||
|
||||
Thanks to the authors of the original models for their incredible work:
|
||||
|
||||
- SicariusSicariiStuff for `Impish_Bloodmoon_12B` and `Impish_Bloodmoon_12B_Abliterated`
|
||||
- DreadPoor for `Famino-12B-Model_Stock`
|
||||
- PygmalionAI for `Eleusis-12B` and `PygmalionAI/Pygmalion-3-12B`
|
||||
- Vortex5 for `Azure-Starlight-12B`
|
||||
Reference in New Issue
Block a user