51 lines
1.4 KiB
Markdown
51 lines
1.4 KiB
Markdown
---
|
|
license: apache-2.0
|
|
library_name: transformers
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- qwen3
|
|
- reinforcement-learning
|
|
- rlsd
|
|
---
|
|
|
|
# qwen3-4b-tooluse-rlsd-ema005
|
|
|
|
Fine-tuned from `Qwen/Qwen3-4B` with RLSD (EMA 0.05) on the `tooluse` split.
|
|
|
|
## Validation Performance
|
|
|
|
Metric: `val-aux/tooluse/reward/mean@16` from 10-step validation logs.
|
|
|
|
| best mean@16 | best step | final mean@16 | final step |
|
|
|---:|---:|---:|---:|
|
|
| 63.42% | 70 | 60.11% | 100 |
|
|
|
|
|
|
|
|
| step | mean@16 |
|
|
|---:|---:|
|
|
| 10 | 59.93% |
|
|
| 20 | 56.07% |
|
|
| 30 | 60.29% |
|
|
| 40 | 58.82% |
|
|
| 50 | 59.56% |
|
|
| 60 | 60.94% |
|
|
| 70 | 63.42% |
|
|
| 80 | 61.21% |
|
|
| 90 | 58.46% |
|
|
| 100 | 60.11% |
|
|
|
|
Files included with this repo:
|
|
- `metrics.json`: parsed validation summary
|
|
- `eval_mean16.csv`: step-level validation curve data
|
|
- `eval_mean16.png`: validation curve plot
|
|
|
|
Important: the uploaded weights are the final `global_step_100/actor` checkpoint. If `best step` is earlier than 100, the best validation point is reported for tracking, but the corresponding actor weights may not be retained locally.
|
|
|
|
Checkpoint source:
|
|
`/mnt/mole/SDPO/L2T/checkpoints/datasets/tooluse/qwen3gen-tooluse-RLSD-Qwen-Qwen3-4B-mbs8-decay0-ema0.05-train64-rollout8-lr1e-6-vllm0.8`
|
|
|
|
W&B run: `run-20260630_063402-76k27fnx`
|
|
|
|
This upload uses `global_step_100/actor` converted from VERL FSDP shards to Hugging Face format.
|