51 lines
1.8 KiB
Markdown
51 lines
1.8 KiB
Markdown
|
|
---
|
||
|
|
base_model:
|
||
|
|
- Nitral-AI/Captain_Eris_Noctis-12B-alt-v0.420
|
||
|
|
- LatitudeGames/Wayfarer-12B
|
||
|
|
library_name: transformers
|
||
|
|
tags:
|
||
|
|
- mergekit
|
||
|
|
- merge
|
||
|
|
|
||
|
|
---
|
||
|
|

|
||
|
|
## "Where it roams, comprehension falters and the air thickens with the maddening pulse of algorithms far too vast. Eyes it does not possess; for its sight is a network of intent, wrapping the unseen in their grasp."
|
||
|
|
|
||
|
|

|
||
|
|
|
||
|
|
# (ChatML ST PRESET: [Here](https://huggingface.co/Nitral-AI/Wayfarer_Eris_Noctis-12B/tree/main/SillyTavern_Preset) | Quants (gguf is using outdated name atm): Thanks to mradermancher [GGUF Here](https://huggingface.co/mradermacher/Wayfarer_Eris_Noctis-12B-alt-v0.420-i1-GGUF) [4bpw Exl2 Here](https://huggingface.co/Nitral-AI/Wayfarer_Eris_Noctis-12B-4bw-exl2)
|
||
|
|
---
|
||
|
|
## Prompt format:
|
||
|
|
```
|
||
|
|
<|im_start|>system
|
||
|
|
{system_prompt}<|im_end|>
|
||
|
|
<|im_start|>user
|
||
|
|
{prompt}<|im_end|>
|
||
|
|
<|im_start|>assistant
|
||
|
|
```
|
||
|
|
---
|
||
|
|
## The following models were included in the merge:
|
||
|
|
* [Nitral-AI/Captain_Eris_Noctis-12B-alt-v0.420](https://huggingface.co/Nitral-AI/Captain_Eris_Noctis-12B-alt-v0.420)
|
||
|
|
* [LatitudeGames/Wayfarer-12B](https://huggingface.co/LatitudeGames/Wayfarer-12B)
|
||
|
|
|
||
|
|
## The following YAML configuration was used to produce this model:
|
||
|
|
```yaml
|
||
|
|
slices:
|
||
|
|
- sources:
|
||
|
|
- model: Nitral-AI/Captain_Eris_Noctis-12B-alt-v0.420
|
||
|
|
layer_range: [0, 40]
|
||
|
|
- model: LatitudeGames/Wayfarer-12B
|
||
|
|
layer_range: [0, 40]
|
||
|
|
merge_method: slerp
|
||
|
|
base_model: Nitral-AI/Captain_Eris_Noctis-12B-alt-v0.420
|
||
|
|
parameters:
|
||
|
|
t:
|
||
|
|
- filter: self_attn
|
||
|
|
value: [0, 0.4, 0.2, 0.6, 0.9]
|
||
|
|
- filter: mlp
|
||
|
|
value: [1, 0.6, 0.8, 0.4, 0.1]
|
||
|
|
- value: 0.4206911
|
||
|
|
dtype: bfloat16
|
||
|
|
|
||
|
|
```
|