---
base_model: Qwen/Qwen3-4B
library_name: transformers
tags:
  - horus-llm
  - dpo-grpo
---
# qwen3-4b — DPO-GRPO (QLoRA, K=4, ctx=6168)