Zachary1150/merge_cosfmt_MRL4096_ROLLOUT4_LR5e-7_w0.5_ties
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Zachary1150/merge_cosfmt_MRL4096_ROLLOUT4_LR5e-7_w0.5_ties
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-23 16:25:50 +08:00
commit 7bdcd88d41
8 changed files with 303474 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
mergekit_config.yml Normal file
View File

@@ -0,0 +1,14 @@
models:
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/cos_MRL4096_ROLLOUT4_LR5e-7/global_step_54/actor/huggingface
parameters:
weight: 0.5
density: 0.5
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/accfmt_MRL4096_ROLLOUT4_LR5e-7/global_step_54/actor/huggingface
parameters:
weight: 0.5
density: 0.5
merge_method: ties
parameters:
normalize: true
dtype: bfloat16
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B