Aratako/Swallow-MoE-2x13B-v0.1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Aratako/Swallow-MoE-2x13B-v0.1
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-28 16:16:14 +08:00
commit dd21bb0db6
16 changed files with 295 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
mergekit_moe_config.yml Normal file
View File

@@ -0,0 +1,9 @@
base_model: ./Superswallow-13b-v0.2
gate_mode: random
dtype: bfloat16
experts:
- source_model: ./Superswallow-13b-v0.2
positive_prompts: []
- source_model: ./Swallow-13b-instruct-hf
positive_prompts: []
tokenizer_source: union