初始化项目,由ModelHub XC社区提供模型
Model: normster/RealGuardrails-Qwen2.5-7B-SFT Source: Original Platform
This commit is contained in:
28
README.md
Normal file
28
README.md
Normal file
@@ -0,0 +1,28 @@
|
||||
---
|
||||
license: mit
|
||||
datasets:
|
||||
- normster/RealGuardrails
|
||||
base_model:
|
||||
- Qwen/Qwen2.5-7B
|
||||
library_name: transformers
|
||||
---
|
||||
|
||||
# RealGuardrails Models
|
||||
|
||||
This model was trained on the [RealGuardrails](https://huggingface.co/datasets/normster/RealGuardrails) dataset, an instruction-tuning dataset focused on improving system prompt adherence and precedence. In particular, it was trained via SFT on the `systemmix` split of ~150K examples using our custom training library [torchllms](https://github.com/normster/torchllms) and converted back to a `transformers` compatible checkpoint.
|
||||
|
||||
## Training Hyperparameters
|
||||
|
||||
| Name | Value |
|
||||
| :--- | :--- |
|
||||
| optimizer | AdamW |
|
||||
| batch size | 128 |
|
||||
| learning rate | 2e-5 |
|
||||
| lr scheduler | cosine with 200 warmup steps |
|
||||
| betas | (0.9, 0.999) |
|
||||
| eps | 1e-8 |
|
||||
| weight decay | 0 |
|
||||
| epochs | 1 |
|
||||
| max grad norm | 1.0 |
|
||||
| precision | bf16 |
|
||||
| max length | 4096 |
|
||||
Reference in New Issue
Block a user