EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
Files
e9bebafb190dadeaa76e6e5b224fef552a9df139
sglang/benchmark/json_schema
History
applesaucethebun 2ce8793519 Add typo checker in pre-commit (#6179) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-11 12:55:00 +08:00
..
bench_sglang.py
Add typo checker in pre-commit (#6179)
2025-05-11 12:55:00 +08:00
README.md
benchmark json schema (#2030)
2024-11-15 05:06:19 -08:00

README.md

Run benchmark

Benchmark sglang

Run Llama-8b

python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --port 30000

Benchmark

python3 bench_sglang.py