sglang/python/sglang/README.md

Code Structures

• lang: The frontend language.
• srt: The backend engine for running local models. (SRT = SGLang Runtime).
• test: Test utilities.
• api.py: Public API.
• bench_latency.py: Benchmark a single static batch.
• bench_serving.py: Benchmark online serving with dynamic requests.
• global_config.py: The global configs and constants.
• launch_server.py: The entry point of launching local server.
• utils.py: Common utilities.