Qwen2.5-Math-7B-16k-think/README.md

license, library_name, pipeline_tag

license	library_name	pipeline_tag
mit	transformers	text-generation

The base Qwen2.5-Math-7B model used by LUFFY, described in Learning to Reason under Off-Policy Guidance. We change to rope_theta from 10000 to 40000 and extend the context window to 16k. Also, we modify the chat_template for the system prompt and add .

Github: https://github.com/ElliottYan/LUFFY

Citation

If you find our model, data, or evaluation code useful, please kindly cite our paper:

@misc{luffy,
      title={Learning to Reason under Off-Policy Guidance}, 
      author={Jianhao Yan and Yafu Li and Zican Hu and Zhi Wang and Ganqu Cui and Xiaoye Qu and Yu Cheng and Yue Zhang},
      year={2025},
      eprint={2504.14945},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2504.14945}, 
}