78 lines
3.7 KiB
Markdown
78 lines
3.7 KiB
Markdown
|
---
|
||
|
|
base_model:
|
||
|
|
- Qwen/Qwen3-4B-Instruct-2507
|
||
|
|
license: mit
|
||
|
|
library_name: transformers
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
---
|
||
|
|
|
||
|
|
## **LiteCoder-Terminal-4b-sft**
|
||
|
|
|
||
|
|
[**Paper**](https://huggingface.co/papers/2605.29559) | [**Code**](https://github.com/icip-cas/LiteCoder) | [**Blog Post**](https://huggingface.co/blog/Lite-Coder/releasing-litecoder-terminal)
|
||
|
|
|
||
|
|
**LiteCoder-Terminal-4b-sft** is part of our latest release on lightweight code agents. The model is fine-tuned from `Qwen3-4B-Instruct-2507` on the [LiteCoder-Terminal-SFT](https://huggingface.co/datasets/Lite-Coder/LiteCoder-Terminal-SFT) dataset.
|
||
|
|
|
||
|
|
Compared to our previous preview version, we scaled up the training data from under 1,000 samples to 11,255 trajectories, incorporating a broader task taxonomy and diverse agent scaffolds. With these updates, the model shows consistent improvements across Terminal Bench evaluations.
|
||
|
|
|
||
|
|
## **Released Artifacts**
|
||
|
|
|
||
|
|
| Date | Type | Link |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| 2026/04/13 | Model | [**LiteCoder-Terminal-30b-a3b-sft**](https://huggingface.co/Lite-Coder/LiteCoder-Terminal-30b-a3b-sft) |
|
||
|
|
| 2026/04/13 | Model | [**LiteCoder-Terminal-4b-sft**](https://huggingface.co/Lite-Coder/LiteCoder-Terminal-4b-sft) |
|
||
|
|
| 2026/04/13 | Dataset | [**LiteCoder-Terminal-SFT**](https://huggingface.co/datasets/Lite-Coder/LiteCoder-Terminal-SFT) |
|
||
|
|
| 2026/04/13 | Dataset | [**LiteCoder-Terminal-World-Model-SFT**](https://huggingface.co/datasets/Lite-Coder/LiteCoder-Terminal-World-Model-SFT) |
|
||
|
|
| 2026/04/13 | Dataset | [**LiteCoder-Terminal-RL-preview**](https://huggingface.co/datasets/Lite-Coder/LiteCoder-Terminal-RL-preview) |
|
||
|
|
| 2026/04/13 | Code | [**icip-cas/LiteCoder**](https://github.com/icip-cas/LiteCoder) |
|
||
|
|
|
||
|
|
## **Results**
|
||
|
|
|
||
|
|
### Terminal Bench 1.0 Performance
|
||
|
|
|
||
|
|
| Model | Agent | pass@1 | pass@4 |
|
||
|
|
| --- | --- | --- | --- |
|
||
|
|
| **LiteCoder-Terminal-30b-a3b-sft** | Terminus 2 | **24.38%** | **40%** |
|
||
|
|
| Qwen3-30B-A3B-Nex-N1 | Openhands | 18.44% | 32.5% |
|
||
|
|
| LiteCoder-30a3b-Terminal-preview | Terminus 2 | 16.56% | 27.5% |
|
||
|
|
| Qwen3-30B-A3B-Instruct | Terminus 2 | 16.56% | 28.75% |
|
||
|
|
| **LiteCoder-Terminal-4b-sft** | Terminus 2 | **14.69%** | **28.75%** |
|
||
|
|
| OpenThinker-Agent-v1 | Terminus 2 | 11.25% | 25% |
|
||
|
|
| LiteCoder-4b-Terminal-preview | Terminus 2 | 9.38% | 20% |
|
||
|
|
| Qwen3-4B-Instruct | Terminus 2 | 6.25% | 15% |
|
||
|
|
|
||
|
|
### Terminal Bench 2.0 Performance
|
||
|
|
|
||
|
|
| Model | Agent | pass@1 | pass@4 |
|
||
|
|
| --- | --- | --- | --- |
|
||
|
|
| **LiteCoder-Terminal-30b-a3b-sft** | Terminus 2 | **12.36%** | **23.60%** |
|
||
|
|
| Qwen3-30B-A3B-Nex-N1 | Openhands | 12.36% | 23.60% |
|
||
|
|
| LiteCoder-30a3b-Terminal-preview | Terminus 2 | 6.18% | 13.75% |
|
||
|
|
| Qwen3-30B-A3B-Instruct | Terminus 2 | 5.34% | 11.24% |
|
||
|
|
| **LiteCoder-Terminal-4b-sft** | Terminus 2 | **4.78%** | **10.11%** |
|
||
|
|
| OpenThinker-Agent-v1 | Terminus 2 | 4.49% | 10.1% |
|
||
|
|
| LiteCoder-4b-Terminal-preview | Terminus 2 | 4.78% | 12.36% |
|
||
|
|
| Qwen3-4B-Instruct | Terminus 2 | 1.12% | 3.37% |
|
||
|
|
|
||
|
|
### Terminal Bench Pro Performance
|
||
|
|
|
||
|
|
| Model | Agent | pass@1 |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| **LiteCoder-Terminal-30b-a3b-sft** | Terminus 2 | **31.5%** |
|
||
|
|
| LiteCoder-30a3b-Terminal-preview | Terminus 2 | 22.0% |
|
||
|
|
| **LiteCoder-Terminal-4b-sft** | Terminus 2 | **21.5%** |
|
||
|
|
| Qwen3-30B-A3B-Nex-N1 | Openhands | 21.0% |
|
||
|
|
| Qwen3-30B-A3B-Instruct | Terminus 2 | 20.5% |
|
||
|
|
| OpenThinker-Agent-v1 | Terminus 2 | 19.5% |
|
||
|
|
| LiteCoder-4b-Terminal-preview | Terminus 2 | 15.0% |
|
||
|
|
| Qwen3-4B-Instruct | Terminus 2 | 3.5% |
|
||
|
|
|
||
|
|
## **Citation**
|
||
|
|
|
||
|
|
```bibtex
|
||
|
|
@article{peng2026litecoderterminal,
|
||
|
|
title={LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents},
|
||
|
|
author={Peng, Xiaoxuan and Zhang, Kaiqi and Lu, Xinyu and Cao, Boxi and Lu, Yaojie and Lin, Hongyu and Han, Xianpei and Sun, Le},
|
||
|
|
journal={arXiv preprint arXiv:2605.29559},
|
||
|
|
year={2026}
|
||
|
|
}
|
||
|
|
```
|