sail/Llama-3-Base-8B-DICE-Iter2
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Improve model card with pipeline tag and code link (#1)

Browse Source 
- Improve model card with pipeline tag and code link (6312a4727d4ea69941f8a6ac5a89a59b44f68977)

Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
This commit is contained in:
ai-modelscope
2025-03-12 01:34:31 +08:00
parent 5b8c4d9aef
commit a5f40ffea9
1 changed files with 6 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
README.md
View File

@@ -1,19 +1,17 @@
---
library_name: transformers
license: mit
datasets:
- HuggingFaceH4/ultrafeedback_binarized
language:
- en
library_name: transformers
license: mit
pipeline_tag: text-generation
---
<!-- This is a model released from the preprint: *[Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760)*. Please refer to our [repository](https://github.com/sail-sg/dice) for more details. -->
# Llama-3-Base-8B-DICE-Iter2
This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 2, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point.
<!-- We utilized the prompt sets extracted from [HuggingFaceH4/ultrafeedback_binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized). -->
## Links to Other Models
- [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1)
- [Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2)
@@ -33,6 +31,9 @@ This model was developed using [Bootstrapping Language Models with DPO Implicit
|[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77
|[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99**
## Code
https://github.com/sail-sg/dice
## Citation
```bibtex