13 lines
253 B
Markdown
13 lines
253 B
Markdown
|
---
|
||
|
|
license: cc-by-nc-4.0
|
||
|
|
---
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
* [This is DPO improved version of cloudyu/Mixtral_11Bx2_MoE_19B](https://huggingface.co/cloudyu/Mixtral_11Bx2_MoE_19B)
|
||
|
|
|
||
|
|
* [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer)
|
||
|
|
|
||
|
|
* metrics not test!
|
||
|
|
|
||
|
|
*
|