This is a model released from the preprint: SimPO: Simple Preference Optimization with a Reference-Free Reward Please refer to our repository for more details.

Description
Model synced from source: princeton-nlp/Mistral-7B-Instruct-DPO
Readme 2.2 MiB