初始化项目,由ModelHub XC社区提供模型
Model: UKPLab/ProReviewer-8B Source: Original Platform
This commit is contained in:
103
README.md
Normal file
103
README.md
Normal file
@@ -0,0 +1,103 @@
|
||||
---
|
||||
library_name: transformers
|
||||
base_model: Qwen/Qwen3-8B
|
||||
model_type: qwen3
|
||||
pipeline_tag: text-generation
|
||||
license: mit
|
||||
language:
|
||||
- en
|
||||
tags:
|
||||
- peer-review
|
||||
- scientific-papers
|
||||
- GRPO
|
||||
- reinforcement-learning
|
||||
- paper-review
|
||||
datasets:
|
||||
- UKPLab/ProReviewer-Dataset
|
||||
citation: |
|
||||
@article{fang2026passive,
|
||||
title={From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent},
|
||||
author={Fang, Haishuo and Feng, Yue and Gurevych, Iryna},
|
||||
journal={arXiv preprint arXiv:2606.13349},
|
||||
year={2026}
|
||||
}
|
||||
---
|
||||
|
||||
# ProReviewer-8B
|
||||
|
||||
An RL-trained scientific peer review model based on [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B). ProReviewer-8B is fine-tuned using Group Relative Policy Optimization (GRPO) to produce high-quality, evidence-based peer reviews of scientific papers.
|
||||
|
||||
## Model Description
|
||||
|
||||
ProReviewer-8B is the backbone model for the **ProReviewer** agent, an R1-style reasoning agent that reviews scientific papers through structured investigation rather than passive generation. The model was trained with a multi-stage curriculum:
|
||||
|
||||
|
||||
### Training Details
|
||||
|
||||
| Parameter | Value |
|
||||
|-----------|-------|
|
||||
| Base model | Qwen/Qwen3-8B |
|
||||
| Training method | SFT+ GRPO with step-level advantages |
|
||||
| Training data | ICLR 2025 papers ([UKPLab/ProReviewer-Dataset](https://huggingface.co/datasets/UKPLab/ProReviewer-Dataset)) |
|
||||
| Architecture | Qwen3ForCausalLM |
|
||||
| Parameters | 8B |
|
||||
| Precision | bfloat16 |
|
||||
|
||||
## Usage
|
||||
|
||||
### With vLLM
|
||||
|
||||
```bash
|
||||
vllm serve UKPLab/ProReviewer-8B --max-model-len 32768 --dtype bfloat16
|
||||
```
|
||||
|
||||
### With the ProReviewer Agent
|
||||
|
||||
The recommended way to use this model is through the ProReviewer agent framework in the [ProReviewer](https://github.com/UKPLab/arxiv2026-ProReviewer):
|
||||
|
||||
```python
|
||||
from reviewer.evaluation import run_inference
|
||||
|
||||
paper = {
|
||||
"paper_id": "example",
|
||||
"paper_content": "# Paper Title\n\nAbstract: ...",
|
||||
"human_avg_score": 5.0,
|
||||
}
|
||||
|
||||
# Option 1: Use a config name from config.toml (model served via vLLM)
|
||||
result = await run_inference(paper, model="proreviewer-8B")
|
||||
|
||||
# Option 2: Use a local path (loads model directly via vLLM)
|
||||
result = await run_inference(paper, model="/path/to/ProReviewer-8B")
|
||||
```
|
||||
|
||||
|
||||
### With Transformers
|
||||
|
||||
```python
|
||||
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||
|
||||
model = AutoModelForCausalLM.from_pretrained("UKPLab/ProReviewer-8B", torch_dtype="bfloat16")
|
||||
tokenizer = AutoTokenizer.from_pretrained("UKPLab/ProReviewer-8B")
|
||||
```
|
||||
|
||||
## Associated Resources
|
||||
|
||||
- **Paper**: [From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent](https://arxiv.org/abs/2606.13349)
|
||||
- **Code**: [UKPLab/arxiv2026-ProReviewer](https://github.com/UKPLab/arxiv2026-ProReviewer)
|
||||
- **Dataset**: [UKPLab/ProReviewer-Dataset](https://huggingface.co/datasets/UKPLab/ProReviewer-Dataset)
|
||||
|
||||
## Citation
|
||||
|
||||
```bibtex
|
||||
@article{fang2026passive,
|
||||
title={From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent},
|
||||
author={Fang, Haishuo and Feng, Yue and Gurevych, Iryna},
|
||||
journal={arXiv preprint arXiv:2606.13349},
|
||||
year={2026}
|
||||
}
|
||||
```
|
||||
|
||||
## License
|
||||
|
||||
This model is released under the [MIT License](https://opensource.org/licenses/MIT).
|
||||
Reference in New Issue
Block a user