kalomaze/distillama-25b-test1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: kalomaze/distillama-25b-test1
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-03 17:21:12 +08:00
commit d95e38ad4f
14 changed files with 2242 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
mergekit_moe_config.yml Normal file
View File

@@ -0,0 +1,12 @@
base_model: Undi95/Meta-Llama-3-8B-hf
gate_mode: random
dtype: bfloat16
experts:
- source_model: Undi95/Meta-Llama-3-8B-hf
positive_prompts: []
- source_model: Undi95/Meta-Llama-3-8B-hf
positive_prompts: []
- source_model: Undi95/Meta-Llama-3-8B-hf
positive_prompts: []
- source_model: Undi95/Meta-Llama-3-8B-hf
positive_prompts: []