diff --git a/README.md b/README.md index 9edf69e..31a300a 100644 --- a/README.md +++ b/README.md @@ -1,19 +1,17 @@ --- -library_name: transformers -license: mit datasets: - HuggingFaceH4/ultrafeedback_binarized language: - en +library_name: transformers +license: mit +pipeline_tag: text-generation --- - # Llama-3-Base-8B-DICE-Iter2 This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 2, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point. - - ## Links to Other Models - [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) - [Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) @@ -33,6 +31,9 @@ This model was developed using [Bootstrapping Language Models with DPO Implicit |[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77 |[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99** +## Code +https://github.com/sail-sg/dice + ## Citation ```bibtex