MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
Qwen3-4B-Instruct-2507-DPO-…/README.md
ModelHub XC b8ae6b8056 初始化项目，由ModelHub XC社区提供模型 
Model: MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
Source: Original Platform
2026-07-26 08:26:11 +08:00

247 B
Raw Permalink Blame History

library_name, tags, datasets, base_model
library_name tags datasets base_model
transformers
trl
dpo
argilla/ultrafeedback-binarized-preferences
Qwen/Qwen3-4B-Instruct-2507

Qwen3-4B-Instruct-2507 aligned using DPO on the argilla/ultrafeedback-binarized-preferences