Simplify frontend language (#9029)

This commit is contained in:
Lianmin Zheng
2025-08-10 10:59:30 -07:00
committed by GitHub
parent 6345069f6c
commit b58ae7a2a0
9 changed files with 19 additions and 17 deletions

View File

@@ -5,7 +5,7 @@
- `srt`: The backend engine for running local models. (SRT = SGLang Runtime).
- `test`: The test utilities.
- `api.py`: The public APIs.
- `bench_offline_throughput.py`: Benchmark the throughput in the offline mode.
- `bench_offline_throughput.py`: Benchmark the performance in the offline mode.
- `bench_one_batch.py`: Benchmark the latency of running a single static batch without a server.
- `bench_one_batch_server.py`: Benchmark the latency of running a single batch with a server.
- `bench_serving.py`: Benchmark online serving with dynamic requests.