6e2e3cb8394caa849ef5912248bca364464e47c0
Model: princeton-nlp/Mistral-7B-Base-SFT-RRHF Source: Original Platform
This is a model released from the preprint: SimPO: Simple Preference Optimization with a Reference-Free Reward. Please refer to our repository for more details.
Description