9 lines
291 B
YAML
9 lines
291 B
YAML
models:
|
|
- model: lucyknada/microsoft_WizardLM-2-7B
|
|
- model: mergekit-community/TopEvolution
|
|
merge_method: slerp
|
|
base_model: mergekit-community/TopEvolution
|
|
dtype: bfloat16
|
|
parameters:
|
|
t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
|