Files

Lianmin Zheng 617aa2b248 [Auto Sync] Update parallel_state.py (20250907) (#10126 )

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>

2025-09-07 02:12:32 -07:00

eval

Minor style fixes for sgl-kernel (#9289 )

2025-08-18 09:38:35 -07:00

lang

Move parsers under a single folder (#9912 )

2025-09-02 18:25:04 -07:00

srt

[Auto Sync] Update parallel_state.py (20250907) (#10126 )

2025-09-07 02:12:32 -07:00

test

[CI] Refactor disaggregation tests (#10068 )

2025-09-06 22:14:46 +08:00

__init__.py

Refactor the docs (#9031 )

2025-08-10 19:49:45 -07:00

bench_offline_throughput.py

Feature/modelscope model download (#8083 )

2025-07-31 17:29:31 -07:00

bench_one_batch_server.py

add dataset_path for bench_one_batch_server.py (#10113 )

2025-09-07 14:07:09 +08:00

bench_one_batch.py

Adds initialize_moe_config to bench_one_batch so MOE backend is respected (#9670 )

2025-08-29 17:29:32 -07:00

bench_serving.py

chore: enhance bench_serving for vlms with a new dataset of configurable image count and resolution (#9583 )

2025-08-26 17:42:54 -07:00

check_env.py

Revert "feat: replace Decord with video_reader-rs" (#8077 )

2025-07-15 20:04:56 -07:00

compile_deep_gemm.py

[bugfix] Add 'disaggregation_mode' parameter to warmup function when compile deep_gemm manually (#8618 )

2025-08-01 16:02:53 -07:00

global_config.py

Reduce memory accumulation in long-running server (#8306 )

2025-08-03 15:03:16 +08:00

launch_server.py

Separate two entry points: Engine and HTTP server (#2996 )

2025-01-19 22:09:24 -08:00

profiler.py

Improve bench_one_batch_server script (#9608 )

2025-08-26 10:38:37 +08:00

README.md

Simplify frontend language (#9029 )

2025-08-10 10:59:30 -07:00

utils.py

[Doc] Fix SGLang tool parser doc (#9886 )

2025-09-04 21:52:53 +08:00

version.py

chore: bump v0.5.2rc2 (#10050 )

2025-09-04 20:07:27 -07:00

README.md

Code Structures

eval: The evaluation utilities.
lang: The frontend language.
srt: The backend engine for running local models. (SRT = SGLang Runtime).
test: The test utilities.
api.py: The public APIs.
bench_offline_throughput.py: Benchmark the performance in the offline mode.
bench_one_batch.py: Benchmark the latency of running a single static batch without a server.
bench_one_batch_server.py: Benchmark the latency of running a single batch with a server.
bench_serving.py: Benchmark online serving with dynamic requests.
check_env.py: Check the environment variables and dependencies.
global_config.py: The global configs and constants.
launch_server.py: The entry point for launching the local server.
utils.py: Common utilities.
version.py: Version info.