初始化项目,由ModelHub XC社区提供模型
Model: kainatq/KaidenRp2400_12b_v1 Source: Original Platform
This commit is contained in:
85
README.md
Normal file
85
README.md
Normal file
@@ -0,0 +1,85 @@
|
||||
---
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
tags:
|
||||
- merge
|
||||
- mergekit
|
||||
- roleplay
|
||||
- rp
|
||||
base_model:
|
||||
- mistralai/Mistral-Nemo-Base-2407
|
||||
---
|
||||
|
||||
# KaidenRp2400_12b_v1
|
||||
|
||||
Merged using mergekit.
|
||||
we first merge some models in merge1 then we megre another list of models in merge2 then we merged them together.
|
||||
|
||||
here are intermediate merges:
|
||||
(kainatq/KaidenRp2400_12b_v1_m1](https://huggingface.co/kainatq/KaidenRp2400_12b_v1_m1)
|
||||
[https://huggingface.co/kainatq/KaidenRp2400_12b_v1_m2](https://huggingface.co/kainatq/KaidenRp2400_12b_v1_m2)
|
||||
## Usage:
|
||||
follow [mistral-nemo-base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407) (chatml) instructions.
|
||||
## Merge Configuration
|
||||
|
||||
### Merge 1:
|
||||
|
||||
```yaml
|
||||
merge_method: dare_ties
|
||||
base_model: mistralai/Mistral-Nemo-Base-2407
|
||||
tokenizer_source: union
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: 1.0
|
||||
models:
|
||||
- model: Gryphe/Pantheon-RP-1.5-12b-Nemo
|
||||
parameters:
|
||||
weight: 0.33
|
||||
- model: kainatq/RP-king-12b-II
|
||||
parameters:
|
||||
weight: 0.33
|
||||
- model: elinas/Chronos-Gold-12B-1.0
|
||||
parameters:
|
||||
weight: 0.34
|
||||
|
||||
```
|
||||
|
||||
### Merge 2:
|
||||
```yaml
|
||||
merge_method: dare_ties
|
||||
base_model: mistralai/Mistral-Nemo-Base-2407
|
||||
tokenizer_source: union
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: 1.0
|
||||
models:
|
||||
- model: mergekit-community/MN-Sappho-g2-12B
|
||||
parameters:
|
||||
weight: 0.33
|
||||
- model: nbeerbower/Nemoties-ChatML-12B
|
||||
parameters:
|
||||
weight: 0.33
|
||||
- model: pbevan11/Mistral-Nemo-Baseline-SFT
|
||||
parameters:
|
||||
weight: 0.34
|
||||
```
|
||||
### final model:
|
||||
|
||||
```yaml
|
||||
merge_method: dare_ties
|
||||
base_model: mistralai/Mistral-Nemo-Base-2407
|
||||
tokenizer_source: union
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: 1.0
|
||||
models:
|
||||
- model: kainatq/KaidenRp2400_12b_v1_m1
|
||||
parameters:
|
||||
weight: 0.40
|
||||
- model: kainatq/KaidenRp2400_12b_v1_m2
|
||||
parameters:
|
||||
weight: 0.40
|
||||
- model: mergekit-community/MN-Sappho-j-12B
|
||||
parameters:
|
||||
weight: 0.20
|
||||
```
|
||||
Reference in New Issue
Block a user