jtatman/TinyDolphin-3x-MoE
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: jtatman/TinyDolphin-3x-MoE
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-11 14:37:11 +08:00
commit 34382bb3eb
13 changed files with 93679 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
mergekit_moe_config.yml Normal file
View File

@@ -0,0 +1,14 @@
base_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
gate_mode: hidden
dtype: float16
experts:
- source_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
positive_prompts:
- "think step-by-step and follow these instructions"
- "read the following passage, and summarize it in less than 30 words."
- "please answer this question, consider the options carefully, and return the most likely answer."
- source_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
positive_prompts: ["produce python code"]
- source_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
positive_prompts: ["What is 2 x 22?"]