Zachary1150/merge_lenfmt_MRL4096_ROLLOUT4_LR2e-6_w0.5_ties
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Zachary1150/merge_lenfmt_MRL4096_ROLLOUT4_LR2e-6_w0.5_ties
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-28 03:32:03 +08:00
commit cf0a199c26
8 changed files with 303474 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
mergekit_config.yml Normal file
View File

@@ -0,0 +1,14 @@
models:
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/len_MRL4096_ROLLOUT4_LR2e-6/global_step_40/actor/huggingface
parameters:
weight: 0.5
density: 0.5
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/accfmt_MRL4096_ROLLOUT4_LR2e-6/global_step_30/actor/huggingface
parameters:
weight: 0.5
density: 0.5
merge_method: ties
parameters:
normalize: true
dtype: bfloat16
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B