Files
Mistral-7B-Instruct-demi-me…/mergekit_config.yml

13 lines
277 B
YAML
Raw Permalink Normal View History

slices:
- sources:
- model: mistralai/Mistral-7B-Instruct-v0.3
layer_range: [0,32]
- model: mistralai/Mistral-7B-v0.3
layer_range: [0,32]
merge_method: slerp
base_model: mistralai/Mistral-7B-Instruct-v0.3
parameters:
t:
- value: 0.5
dtype: bfloat16