Zachary1150/merge_lenfmt_MRL4096_ROLLOUT4_LR5e-7_w0.5_ties_density0.2
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Zachary1150/merge_lenfmt_MRL4096_ROLLOUT4_LR5e-7_w0.5_ties_density0.2
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-03 20:05:00 +08:00
commit d36a277b65
8 changed files with 303474 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
mergekit_config.yml Normal file
View File

@@ -0,0 +1,14 @@
models:
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/len_MRL4096_ROLLOUT4_LR5e-7/global_step_30/actor/huggingface
parameters:
weight: 0.5
density: 0.2
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/accfmt_MRL4096_ROLLOUT4_LR5e-7/global_step_54/actor/huggingface
parameters:
weight: 0.5
density: 0.2
merge_method: ties
parameters:
normalize: true
dtype: bfloat16
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B