mlabonne/UltraMerge-7B
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mlabonne/UltraMerge-7B
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-15 21:48:26 +08:00
commit e2c343b118
13 changed files with 91603 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

18
README.md Normal file
View File

@@ -0,0 +1,18 @@
---
library_name: transformers
license: cc-by-nc-4.0
tags:
- merge
- automerger
---
# UltraMerge-7B
This model is an experimental DPO fine-tune of [automerger/YamShadow-7B](https://huggingface.co/automerger/YamShadow-7B) on the following datasets:
- mlabonne/truthy-dpo-v0.1
- mlabonne/distilabel-intel-orca-dpo-pairs
- mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha
- mlabonne/ultrafeedback-binarized-preferences-cleaned
I have no idea about what's the best chat template. Probably Mistral-Instruct or ChatML.