46 lines
1.5 KiB
Markdown
46 lines
1.5 KiB
Markdown
|
---
|
||
|
|
base_model:
|
||
|
|
- Epiculous/Violet_Twilight-v0.2
|
||
|
|
- Nitral-AI/Captain_BMO-12B
|
||
|
|
library_name: transformers
|
||
|
|
tags:
|
||
|
|
- mergekit
|
||
|
|
- merge
|
||
|
|
license: other
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
---
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
# Instruct/Context import + Textgen preset combined available: [Here](https://huggingface.co/Nitral-AI/Captain_Violet-V0.420-12B/tree/main/ST)
|
||
|
|
|
||
|
|
## Quants: [4bpw-exl2](https://huggingface.co/Nitral-AI/Captain-Eris_Violet-V0.420-12B-4bpw-exl2) Thanks to Mradermaacher for: [GGUF](https://huggingface.co/mradermacher/Captain-Eris_Violet-V0.420-12B-GGUF) Lewdiculus: [Arm Compatible GGUF's](https://huggingface.co/Lewdiculous/Captain-Eris_Violet-V0.420-12B-GGUF-ARM-Imatrix)<3
|
||
|
|
|
||
|
|
## Original Models used in the merge:
|
||
|
|
[Epiculous/Violet_Twilight-v0.2](https://huggingface.co/Epiculous/Violet_Twilight-v0.2)
|
||
|
|
[Nitral-AI/Captain_BMO-12B](https://huggingface.co/Nitral-AI/Captain_BMO-12B)
|
||
|
|
|
||
|
|
|
||
|
|
### The following YAML configuration was used to produce this model:
|
||
|
|
|
||
|
|
```yaml
|
||
|
|
slices:
|
||
|
|
- sources:
|
||
|
|
- model: Nitral-AI/Captain_BMO-12B
|
||
|
|
layer_range: [0, 40]
|
||
|
|
- model: Epiculous/Violet_Twilight-v0.2
|
||
|
|
layer_range: [0, 40]
|
||
|
|
merge_method: slerp
|
||
|
|
base_model: Nitral-AI/Captain_BMO-12B
|
||
|
|
parameters:
|
||
|
|
t:
|
||
|
|
- filter: self_attn
|
||
|
|
value: [0, 0.5, 0.3, 0.7, 1]
|
||
|
|
- filter: mlp
|
||
|
|
value: [1, 0.5, 0.7, 0.3, 0]
|
||
|
|
- value: 0.420
|
||
|
|
dtype: bfloat16
|
||
|
|
```
|