19 lines
422 B
Markdown
19 lines
422 B
Markdown
|
---
|
||
|
|
base_model: Qwen/Qwen2.5-3B-Instruct
|
||
|
|
library_name: transformers
|
||
|
|
tags:
|
||
|
|
- dpo-grpo
|
||
|
|
- qwen2.5-3b
|
||
|
|
---
|
||
|
|
# qwen2.5-3b — DPO-GRPO
|
||
|
|
|
||
|
|
Merged full-precision model after the **DPO-GRPO** phase of the
|
||
|
|
LLMPR sequential training pipeline (SFT → DPO → Safety-GRPO).
|
||
|
|
|
||
|
|
| Field | Value |
|
||
|
|
|---|---|
|
||
|
|
| Base model | `Qwen/Qwen2.5-3B-Instruct` |
|
||
|
|
| Phase | DPO-GRPO |
|
||
|
|
| Short name | qwen2.5-3b |
|
||
|
|
| Generated | 2026-06-30 03:11 UTC |
|