EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
Files
646076b71e8d12816d94de44a63ea57a568651de
sglang/benchmark/json_schema/README.md
DarkSharpness 954f4e6bd6 benchmark json schema (#2030)
2024-11-15 05:06:19 -08:00

205 B
Raw Blame History

Run benchmark

Benchmark sglang

Run Llama-8b

python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --port 30000

Benchmark

python3 bench_sglang.py