初始化项目,由ModelHub XC社区提供模型
Model: TMLR-Group-HF/Co-rewarding-I-Qwen3-8B-Base-DAPO14k Source: Original Platform
This commit is contained in:
17
README.md
Normal file
17
README.md
Normal file
@@ -0,0 +1,17 @@
|
||||
---
|
||||
license: mit
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- qwen3
|
||||
- reasoning
|
||||
- llm
|
||||
---
|
||||
|
||||
### Co-rewarding-I: Qwen3-8B-Base trained on DAPO-14k
|
||||
|
||||
This model is the Qwen3-8B-Base, trained by Co-rewarding-I using the DAPO-14k training set. It was presented in the paper [Co-rewarding: Stable Self-supervised RL for Eliciting Reasoning in Large Language Models](https://huggingface.co/papers/2508.00410).
|
||||
|
||||
Co-rewarding is a novel self-supervised reinforcement learning (RL) framework designed to improve the training stability of large language models (LLMs) for reasoning tasks. This particular model utilizes **Co-rewarding-I**, a data-side instantiation that derives reward signals from contrastive agreement across semantically analogous questions. This approach aims to mitigate the training collapse and reward hacking issues often encountered in single-view self-rewarding methods, thereby enhancing the LLM's reasoning abilities for complex challenges like mathematical reasoning.
|
||||
|
||||
For more details on the Co-rewarding framework, access to the code, and other trained checkpoints, please refer to the official GitHub repository: [https://github.com/tmlr-group/Co-rewarding](https://github.com/tmlr-group/Co-rewarding).
|
||||
Reference in New Issue
Block a user