sglang

Files

yuxingcyx 4edbe0d534 [benchmark] Add benchmark scripts for ceval and boolq (#8946 )

Co-authored-by: chenyuxing <2818499974@qq.com>
Co-authored-by: hanqing <huang010706@126.com>
Co-authored-by: Muggle <62579327+trawolf@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>

2025-08-23 15:40:15 +08:00

bench_sglang.py

[benchmark] Add benchmark scripts for ceval and boolq (#8946 )

2025-08-23 15:40:15 +08:00

README.md

[benchmark] Add benchmark scripts for ceval and boolq (#8946 )

2025-08-23 15:40:15 +08:00

README.md

Download data

git lfs clone https://huggingface.co/datasets/ceval/ceval-exam

Run benchmark

Benchmark sglang

python -m sglang.launch_server --model-path ramblingpolymath/Qwen3-32B-W8A8 --port 30000

python3 bench_sglang.py