Files
merge-passthrough-Meta-Llam…/mergekit_config.yml

10 lines
229 B
YAML
Raw Permalink Normal View History

slices:
- sources:
- model: meta-llama/Meta-Llama-3-8B-Instruct
layer_range: [0, 32]
- sources:
- model: meta-llama/Meta-Llama-3-8B-Instruct
layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16