sail/Llama-3-Base-8B-DICE-Iter1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Add pipeline tag and improve model card (#1)

Browse Source 
- Add pipeline tag and improve model card (8c2b606fc85469d117d76e290a65e5c29e76ca4d)
- Make the README consistent for the model over iterations (ad63cc0daf9fa12a3a3d48861445b5942a12a77c)

Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
This commit is contained in:
ai-modelscope
2025-03-12 03:13:02 +08:00
parent c57760dc36
commit 5c35f80c4b
1 changed files with 6 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
README.md
View File

@@ -1,19 +1,17 @@
--- ---
library_name: transformers
license: mit
datasets: datasets:
- HuggingFaceH4/ultrafeedback_binarized - HuggingFaceH4/ultrafeedback_binarized
language: language:
- en - en
library_name: transformers
license: mit
pipeline_tag: text-generation
--- ---
<!-- This is a model released from the preprint: *[Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760)*. Please refer to our [repository](https://github.com/sail-sg/dice) for more details. -->
# Llama-3-Base-8B-DICE-Iter1 # Llama-3-Base-8B-DICE-Iter1
This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 1, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point. This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 1, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point.
<!-- We utilized the prompt sets extracted from [HuggingFaceH4/ultrafeedback_binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized). -->
## Links to Other Models ## Links to Other Models
- [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) - [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1)
@@ -34,6 +32,9 @@ This model was developed using [Bootstrapping Language Models with DPO Implicit
|[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77 |[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77
|[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99** |[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99**
## Code
https://github.com/sail-sg/dice
## Citation ## Citation
```bibtex ```bibtex