diff --git a/README.md b/README.md index e2dd191..0eacc55 100644 --- a/README.md +++ b/README.md @@ -1,19 +1,17 @@ --- -library_name: transformers -license: mit datasets: - HuggingFaceH4/ultrafeedback_binarized language: - en +library_name: transformers +license: mit +pipeline_tag: text-generation --- - - # Llama-3-Base-8B-DICE-Iter1 This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 1, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point. - ## Links to Other Models - [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) @@ -34,6 +32,9 @@ This model was developed using [Bootstrapping Language Models with DPO Implicit |[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77 |[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99** +## Code +https://github.com/sail-sg/dice + ## Citation ```bibtex