Files

Lianmin Zheng 27d710457c [Auto Sync] Update scheduler.py, server_args.py (20251014) (#11623 )

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>

2025-10-14 13:20:03 -07:00

eval

Minor style fixes for sgl-kernel (#9289 )

2025-08-18 09:38:35 -07:00

lang

[Feature] support regex strings as a stopping condition (#10635 )

2025-10-12 10:53:15 +08:00

srt

[Auto Sync] Update scheduler.py, server_args.py (20251014) (#11623 )

2025-10-14 13:20:03 -07:00

test

make radix cache deterministic (#10721 )

2025-10-14 21:01:52 +08:00

__init__.py

Refactor the docs (#9031 )

2025-08-10 19:49:45 -07:00

bench_offline_throughput.py

Feature/modelscope model download (#8083 )

2025-07-31 17:29:31 -07:00

bench_one_batch_server.py

ci: improve nightly-ci (#11385 )

2025-10-12 21:19:34 -07:00

bench_one_batch.py

Separate allocation logic from scheduler (#11313 )

2025-10-10 17:38:54 -07:00

bench_serving.py

bench_serving support PD Disaggregation (#11542 )

2025-10-13 19:43:26 -07:00

check_env.py

Revert "feat: replace Decord with video_reader-rs" (#8077 )

2025-07-15 20:04:56 -07:00

compile_deep_gemm.py

Move deep gemm related arguments to sglang.srt.environ (#11547 )

2025-10-14 00:34:35 +08:00

global_config.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

launch_server.py

[router][grpc] Add serve_grpc to launch_server and log id for HealthCheck (#11564 )

2025-10-13 16:07:19 -07:00

profiler.py

[FEATURE] Add Profile Trace Merger for Distributed Traces (#11413 )

2025-10-14 09:20:17 +08:00

README.md

Run tests based on labels (#10456 )

2025-09-15 00:29:20 -07:00

utils.py

Move cached kernel to srt.utils (#10776 )

2025-09-22 23:00:36 -07:00

version.py

chore: bump SGLang version to 0.5.3.post1 (#11324 )

2025-10-09 15:19:59 -07:00

README.md

Code Structure

eval: The evaluation utilities.
lang: The frontend language.
srt: The backend engine for running local models. (SRT = SGLang Runtime).
test: The test utilities.
api.py: The public APIs.
bench_offline_throughput.py: Benchmark the performance in the offline mode.
bench_one_batch.py: Benchmark the latency of running a single static batch without a server.
bench_one_batch_server.py: Benchmark the latency of running a single batch with a server.
bench_serving.py: Benchmark online serving with dynamic requests.
check_env.py: Check the environment variables and dependencies.
global_config.py: The global configs and constants.
launch_server.py: The entry point for launching a local server.
utils.py: Common utilities.
version.py: Version info.