Files
my-custom-llama-3.2-1b-merged/mergekit_config.yml

15 lines
320 B
YAML
Raw Permalink Normal View History

merge_method: dare_ties
base_model: meta-llama/Llama-3.2-1B-Instruct
models:
- model: meta-llama/Llama-3.2-1B-Instruct
- model: unsloth/Llama-3.2-1B-Instruct
parameters:
weight: 0.5
density: 0.5
- model: meta-llama/Llama-3.2-1B
parameters:
weight: 0.5
density: 0.5
dtype: bfloat16