sglang/README.md at 646076b71e8d12816d94de44a63ea57a568651de

Files

yuxingcyx 4edbe0d534 [benchmark] Add benchmark scripts for ceval and boolq (#8946 )

Co-authored-by: chenyuxing <2818499974@qq.com>
Co-authored-by: hanqing <huang010706@126.com>
Co-authored-by: Muggle <62579327+trawolf@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>

2025-08-23 15:40:15 +08:00

258 B

Raw Blame History

Download data

git lfs clone https://huggingface.co/datasets/ceval/ceval-exam

Run benchmark

Benchmark sglang

python -m sglang.launch_server --model-path ramblingpolymath/Qwen3-32B-W8A8 --port 30000

python3 bench_sglang.py

258 B Raw Blame History

Download data

Run benchmark

Benchmark sglang

258 B

Raw Blame History