EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
Files
3295cd8af2e6b1f3bc2dfbbce3390f4d64eb78ca
sglang/benchmark/json_schema
History
Lianmin Zheng c29b98e043 Fix json benchmark (#2043)
2024-11-15 05:33:43 -08:00
..
bench_sglang.py
Fix json benchmark (#2043)
2024-11-15 05:33:43 -08:00
README.md
benchmark json schema (#2030)
2024-11-15 05:06:19 -08:00

README.md

Run benchmark

Benchmark sglang

Run Llama-8b

python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --port 30000

Benchmark

python3 bench_sglang.py