ehristoforu/Falcon3-MoE-2x7B-Insruct
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: ehristoforu/Falcon3-MoE-2x7B-Insruct
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-09 00:44:38 +08:00
commit e93bb166ce
14 changed files with 680969 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
mergekit_moe_config.yml Normal file
View File

@@ -0,0 +1,7 @@
base_model: tiiuae/Falcon3-7B-Instruct
gate_mode: random
architecture: mixtral
dtype: bfloat16
experts:
- source_model: tiiuae/Falcon3-7B-Instruct
- source_model: tiiuae/Falcon3-7B-Instruct