初始化项目，由ModelHub XC社区提供模型
Model: limloop/MN-12B-Hydra-RP-RU Source: Original Platform
This commit is contained in:
ModelHub XC
161
README.md
Normal file
161
README.md
Normal file
@@ -0,0 +1,161 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model:
|
||||
- IlyaGusev/vikhr_nemo_orpo_dostoevsky_12b_slerp
|
||||
- DavidAU/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC
|
||||
- Naphula/MN-12B-Mag-Mell-R1-Uncensored
|
||||
- Aleteian/Pathfinder-RP-12B-RU
|
||||
library_name: transformers
|
||||
language:
|
||||
- en
|
||||
- ru
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
- russian
|
||||
- uncensored
|
||||
- roleplay
|
||||
- mixtral-nemo
|
||||
---
|
||||
|
||||
# MN-12B-Hydra-RP-RU
|
||||
|
||||
<details>
|
||||
<summary>🇷🇺 Нажмите, чтобы развернуть описание на русском</summary>
|
||||
|
||||
## 🌟 О модели
|
||||
|
||||
**MN-12B-Hydra-RP-RU** — экспериментальный merge на базе Mistral Nemo 12B, сочетающий:
|
||||
|
||||
* 🎭 Сильные ролевые способности
|
||||
* 📚 Глубокий литературный русский язык
|
||||
* 🔓 Снятую цензуру
|
||||
|
||||
Модель собрана методом TIES-merging, что позволяет объединять веса нескольких моделей с минимальными конфликтами между параметрами.
|
||||
|
||||
## 🎯 Особенности
|
||||
|
||||
* Основной язык — русский
|
||||
* Хорошо держит персонажей и контекст
|
||||
* Следует инструкциям
|
||||
* Сохраняет возможности базового Nemo
|
||||
* Не проходила дополнительного обучения после слияния
|
||||
|
||||
## ⚠️ Важно
|
||||
|
||||
Uncensored-характер модели означает, что она может генерировать контент, который некоторые пользователи сочтут неподобающим.
|
||||
|
||||
</details>
|
||||
|
||||
High-quality TIES merge based on **Mistral Nemo 12B**, optimized for roleplay, strong Russian language capabilities, and uncensored behavior.
|
||||
|
||||
---
|
||||
|
||||
## 🌍 Overview
|
||||
|
||||
**MN-12B-Hydra-RP-RU** is an experimental merge built on top of [Mistral Nemo 12B](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407), combining strengths from multiple fine-tuned models:
|
||||
|
||||
* 🎭 Advanced roleplay capability from Pathfinder-RP
|
||||
* 📚 Deep Russian language fluency inspired by Vikhr + Dostoevsky-style tuning
|
||||
* 🔓 Reduced safety filtering via uncensored components
|
||||
|
||||
The merge was created using **TIES merging**, which allows combining model deltas while minimizing destructive interference between weights.
|
||||
|
||||
---
|
||||
|
||||
## 🎯 Key Features
|
||||
|
||||
| Feature | Description |
|
||||
| ------------------------- | ------------------------------------------------ |
|
||||
| **Languages** | Russian, English |
|
||||
| **Censorship** | Uncensored behavior |
|
||||
| **Roleplay** | Strong character consistency and narrative depth |
|
||||
| **Instruction Following** | Reliable prompt adherence |
|
||||
| **Tool Calling** | Retains base Nemo capabilities |
|
||||
| **Architecture** | Mistral Nemo 12B |
|
||||
|
||||
---
|
||||
|
||||
## 🧩 Model Composition
|
||||
|
||||
The merge combines the following models:
|
||||
|
||||
| Model | Role in merge | Weight |
|
||||
| ------------------------------ | ------------------------- | ------ |
|
||||
| **Pathfinder-RP-12B-RU** | Base model, RP backbone | 0.60 |
|
||||
| **Vikhr Nemo ORPO Dostoevsky** | Literary Russian depth | 0.25 |
|
||||
| **HERETIC Uncensored** | Safety removal | 0.30 |
|
||||
| **Mag-Mell R1 Uncensored** | Additional uncensor delta | 0.20 |
|
||||
|
||||
*Weights shown before normalization (final weights are normalized to sum = 1).*
|
||||
|
||||
---
|
||||
|
||||
## 💡 Usage Example
|
||||
|
||||
```python
|
||||
from transformers import AutoTokenizer, AutoModelForCausalLM
|
||||
import torch
|
||||
|
||||
model_name = "limloop/MN-12B-Hydra-RP-RU"
|
||||
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
||||
model = AutoModelForCausalLM.from_pretrained(
|
||||
model_name,
|
||||
torch_dtype=torch.bfloat16,
|
||||
device_map="auto"
|
||||
)
|
||||
|
||||
prompt = "You are a medieval innkeeper. Greet the traveler!"
|
||||
messages = [{"role": "user", "content": prompt}]
|
||||
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device)
|
||||
|
||||
outputs = model.generate(inputs, max_new_tokens=512, temperature=0.7)
|
||||
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
|
||||
print(response)
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## ⚙️ Merge Details
|
||||
|
||||
Built using [mergekit](https://github.com/cg123/mergekit) with the **TIES** method (Trim, Elect Sign, Merge).
|
||||
|
||||
Core mechanism:
|
||||
|
||||
1. Trim low-magnitude deltas via `density`
|
||||
2. Resolve sign conflicts
|
||||
3. Weighted averaging of aligned parameters
|
||||
|
||||
### Merge Configuration
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Aleteian/Pathfinder-RP-12B-RU
|
||||
weight: 0.6
|
||||
- model: IlyaGusev/vikhr_nemo_orpo_dostoevsky_12b_slerp
|
||||
weight: 0.25
|
||||
density: 0.9
|
||||
- model: DavidAU/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC
|
||||
weight: 0.3
|
||||
density: 0.9
|
||||
- model: Naphula/MN-12B-Mag-Mell-R1-Uncensored
|
||||
weight: 0.2
|
||||
density: 0.9
|
||||
|
||||
merge_method: ties
|
||||
parameters:
|
||||
epsilon: 0.01
|
||||
normalize: true
|
||||
base_model: Aleteian/Pathfinder-RP-12B-RU
|
||||
dtype: bfloat16
|
||||
tokenizer:
|
||||
source: base
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## ⚠️ Known Characteristics
|
||||
|
||||
* No additional post-merge fine-tuning
|
||||
* May switch to English on complex reasoning tasks
|
||||
* Uncensored components allow generation of explicit or controversial content
|
||||
Reference in New Issue
Block a user