31 lines
637 B
Markdown
31 lines
637 B
Markdown
---
|
|
library_name: transformers
|
|
tags:
|
|
- qwen2.5
|
|
- hh-rlhf
|
|
---
|
|
# Model Card for SFT Model Fine-tuned on hh-rlhf Dataset from Qwen2.5-7B
|
|
|
|
This model is supervised fine-tuned from Qwen2.5-7B based on the anthropic helpfulness-harmlessness rlhf datasets.
|
|
|
|
### Model Sources
|
|
|
|
- **Repository:** https://huggingface.co/Qwen/Qwen2.5-7B
|
|
|
|
## Training Procedure
|
|
|
|
### Training Data
|
|
|
|
- **Repository:** https://huggingface.co/datasets/heli-stand/hh-rlhf
|
|
|
|
### Training Hyperparameters
|
|
|
|
- **Optimizer:** Adamw
|
|
- **Learning Rate:** 1e-5
|
|
- **Batch Size:** 128
|
|
- **Epochs:** 1
|
|
- **Max_Length:** 1024
|
|
|
|
## Evaluation Results
|
|
|
|
- **Best Evaluation Loss:** 1.678 |