Files
ELYZA-japanese-Llama-2-MoE-…/mergekit_moe_config.yml

10 lines
304 B
YAML
Raw Permalink Normal View History

base_model: ./ELYZA-japanese-Llama-2-7b-instruct
gate_mode: random
dtype: bfloat16
experts:
- source_model: ./ELYZA-japanese-Llama-2-7b-instruct
positive_prompts: []
- source_model: ./ELYZA-japanese-Llama-2-7b
positive_prompts: []
tokenizer_source: model:./ELYZA-japanese-Llama-2-7b-instruct