初始化项目,由ModelHub XC社区提供模型

Model: Aratako/ELYZA-japanese-Llama-2-MoE-2x7B-v0.1
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-15 14:20:06 +08:00
commit e8e1e4f039
14 changed files with 278 additions and 0 deletions

9
mergekit_moe_config.yml Normal file
View File

@@ -0,0 +1,9 @@
base_model: ./ELYZA-japanese-Llama-2-7b-instruct
gate_mode: random
dtype: bfloat16
experts:
- source_model: ./ELYZA-japanese-Llama-2-7b-instruct
positive_prompts: []
- source_model: ./ELYZA-japanese-Llama-2-7b
positive_prompts: []
tokenizer_source: model:./ELYZA-japanese-Llama-2-7b-instruct