OctoThinker-3B-Short-Zero/README.md

license, datasets, language, base_model, pipeline_tag

license	datasets	language	base_model	pipeline_tag
llama3.2	OctoThinker/MegaMath-Web-Pro-Max LLM360/MegaMath	en	meta-llama/Llama-3.2-3B	text-generation

OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling

OctoThinker-3B-Short-Zero

The OctoThinker family is built on carefully studied mid-training insights, starting from the Llama-3 family, to create a reinforcement learning–friendly base language model.

OctoThinker-3B-Short-Zero is trained using the R1-Zero-style reinforcement learning technique, starting from OctoThinker-3B-Short-Base without any supervised fine-tuning (SFT).

Training Recipe for OctoThinker-3B-Short-Base

Evaluation Results of OctoThinker-3B-Base Series

Note that we adopt the few-shot prompting evaluation for these base language models.

RL Training Dynamics of OctoThinker-3B-Zero Series

More about OctoThinker

Citation

Check out our paper for more details. If you use our models, datasets or find our work useful, please cite

@article{wang2025octothinker,
  title={OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling},
  author={Wang, Zengzhi and Zhou, Fan and Li, Xuefeng and Liu, Pengfei},
  year={2025},
  journal={arXiv preprint arXiv:2506.20512},
  note={Preprint}
}