MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
main
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

library_name, tags, datasets, base_model
library_name tags datasets base_model
transformers
trl
dpo
argilla/ultrafeedback-binarized-preferences
Qwen/Qwen3-4B-Instruct-2507

Qwen3-4B-Instruct-2507 aligned using DPO on the argilla/ultrafeedback-binarized-preferences

Description
Model synced from source: MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
Readme 26 KiB
Languages
Jinja 100%