MInAlA/llama3-dpo-merged
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
llama3-dpo-merged/README.md
ModelHub XC a6b959dc07 初始化项目，由ModelHub XC社区提供模型 
Model: MInAlA/llama3-dpo-merged
Source: Original Platform
2026-07-21 05:37:09 +08:00

251 B
Raw Permalink Blame History

library_name, tags, datasets, base_model
library_name tags datasets base_model
transformers
trl
dpo
argilla/ultrafeedback-binarized-preferences
meta-llama/Llama-3.2-3B-Instruct

Llama-3.2-3B-Instruct aligned using DPO on the argilla/ultrafeedback-binarized-preferences