OpenRLHF/Llama-3-8b-sft-mixture
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: OpenRLHF/Llama-3-8b-sft-mixture
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-13 04:54:36 +08:00
commit b577761741
12 changed files with 413042 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
README.md Normal file
View File

@@ -0,0 +1,14 @@
---
library_name: transformers
tags: []
---
>Copy from https://huggingface.co/RLHFlow/LLaMA3-SFT
>
>We fixed the `generation_config.json`.
This is the SFT checkpoint used for the project [Online-RLHF](https://github.com/RLHFlow/Online-RLHF). Also, check the [technical report here](https://arxiv.org/pdf/2405.07863).
The model is trained from [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) on a mixture of diverse open-source high-quality data for 1 epoch with detailed parameters in the report. It has not been trained by RLHF and can serve as a good starting point for the RLHF research.
The datasets included: ShareGPT, Evol-Instruct, SlimOrca, MathInstruct, Magicoder-Evol-Instruct, GPT4-LLM, OrcaMath, GPTeacher, UltraInteract.