Model: v1olet/v1olet_merged_dpo_7B Source: Original Platform
license, language
| license | language | |
|---|---|---|
| apache-2.0 |
|
DPO from the model ranked 6th on the overall leaderboard and 1st in the 7B leaderboard - v1olet/v1olet_marcoroni-go-bruins-merge-7B.
You can use alpaca template.
template_format = """{system}
### Instruction:
{prompt}
### Response:
"""
Developed by: Trong-Hieu Nguyen-Mau
Description