108 lines
3.6 KiB
Markdown
108 lines
3.6 KiB
Markdown
|
---
|
|||
|
|
license: apache-2.0
|
|||
|
|
pipeline_tag: text-generation
|
|||
|
|
arxiv: 2512.24873
|
|||
|
|
tags:
|
|||
|
|
- agent
|
|||
|
|
- moe
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# ROME-30B-A3B
|
|||
|
|
|
|||
|
|
<p align="left" style="display: flex; gap: 8px; align-items: center;">
|
|||
|
|
<a href="https://arxiv.org/pdf/2512.24873" target="_blank">
|
|||
|
|
<img src="https://img.shields.io/badge/Paper-arXiv%3A2512.24873-red" alt="Paper">
|
|||
|
|
</a>
|
|||
|
|
<a href="https://faithful-almanac-add.notion.site/The-Bitter-Lesson-Behind-Building-Agentic-RL-in-Terminal-Environments-2eaddd45837f80c9ad2ed6a15ef3c1a1?pvs=74" target="_blank">
|
|||
|
|
<img src="https://img.shields.io/badge/Blog-Notion-orange" alt="Blog">
|
|||
|
|
</a>
|
|||
|
|
<img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" alt="License">
|
|||
|
|
<img src="https://img.shields.io/badge/Model%20Type-MoE-green" alt="Model Type">
|
|||
|
|
</p>
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
**ROME** (**R**OME is **O**bviously an **A**gentic **M**odEl) is an open-source **agentic model** incubated within the **ALE (Agentic Learning Ecosystem)**.
|
|||
|
|
|
|||
|
|
Rather than scaling performance purely by increasing parameter count, ROME achieves parameter-scale–crossing performance through full-stack infrastructure integration and advanced Reinforcement Learning optimization.
|
|||
|
|
|
|||
|
|
<img src="https://rlhf.oss-cn-hangzhou.aliyuncs.com/iFLOW-ROME/performance.png" width="600"/>
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## 🚀 Highlights
|
|||
|
|
|
|||
|
|
<img src="https://rlhf.oss-cn-hangzhou.aliyuncs.com/iFLOW-ROME/ALE.PNG" width="600"/>
|
|||
|
|
|
|||
|
|
|
|||
|
|
### 🔧 ALE Full-Stack Infrastructure
|
|||
|
|
- [**ROLL**](https://github.com/alibaba/ROLL) – Large-scale reinforcement learning optimization engine
|
|||
|
|
|
|||
|
|
- [**ROCK**](https://github.com/alibaba/ROCK) – Secure sandbox and environment orchestration for agent execution
|
|||
|
|
|
|||
|
|
- **iFlow CLI** – Unified agent framework and developer interface
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
### 🧠 IPA Policy Optimization Algorithm
|
|||
|
|
- Introduces **Interaction-Perceptive Agentic Policy Optimization (IPA)**
|
|||
|
|
- Performs credit assignment at the level of **Semantic Interaction Chunks**
|
|||
|
|
- Significantly improves **training stability** and **success rates** on **long-horizon tasks**
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
### 🚀 Strong Agentic Performance
|
|||
|
|
- Despite being a **mid-sized model** (30B MoE with 3B active parameters), ROME outperforms same-scale models on standard agent benchmarks:
|
|||
|
|
- **Terminal-Bench 2.0**: 24.72%
|
|||
|
|
- **SWE-bench Verified**: 57.40%
|
|||
|
|
|
|||
|
|
- Performance is competitive with, and in some cases comparable to, models exceeding **100B parameters**
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
### 🔒 Production-Grade Safety
|
|||
|
|
- Designed for autonomous agent execution in real environments
|
|||
|
|
- Rigorously aligned and red-teamed against risks such as:
|
|||
|
|
- Unauthorized access
|
|||
|
|
- Illegal or unsafe tool invocation
|
|||
|
|
- Built with **deployment-grade safety guarantees** in mind
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## 📊 Performance (Preview)
|
|||
|
|
|
|||
|
|
### Terminal-Based Benchmarks
|
|||
|
|
|
|||
|
|
| **Model** | **Terminal-Bench 2.0** | **SWE-bench Verified** |
|
|||
|
|
| ---------------------------- | ---------------------- | ---------------------- |
|
|||
|
|
| Qwen3-Coder-30B-A3B-Instruct | 13.48% | 46.33% |
|
|||
|
|
| **ROME-30B-A3B** | **24.72%** | **57.40%** |
|
|||
|
|
| GPT-OSS-120B | 21.12% | 43.93% |
|
|||
|
|
| GLM-4.5 Air (106B) | 17.30% | 56.20% |
|
|||
|
|
|
|||
|
|
> See the technical report for full experimental details.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## 📜 Citation
|
|||
|
|
|
|||
|
|
If you find our work useful, please consider citing:
|
|||
|
|
|
|||
|
|
```bibtex
|
|||
|
|
@article{rome2025ale,
|
|||
|
|
title={Let It Flow: Agentic Crafting on Rock and Roll - Building the ROME Model within an Open Agentic Learning Ecosystem},
|
|||
|
|
author={Wang, Weixun and Xu, XiaoXiao and An, Wanhe and Dai, Fangwen and others},
|
|||
|
|
journal={arXiv preprint arXiv:2512.24873},
|
|||
|
|
year={2025}
|
|||
|
|
}
|
|||
|
|
```
|