MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-26 08:26:11 +08:00
commit b8ae6b8056
8 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
README.md Normal file
View File

@@ -0,0 +1,12 @@
---
library_name: transformers
tags:
- trl
- dpo
datasets:
- argilla/ultrafeedback-binarized-preferences
base_model:
- Qwen/Qwen3-4B-Instruct-2507
---
Qwen3-4B-Instruct-2507 aligned using DPO on the ``argilla/ultrafeedback-binarized-preferences``