EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
Files
9241f4fd200a5ec30e241ee1de3811b7d67e24f2
sglang/python/sglang
History
Lifu Huang 9241f4fd20 Move cached kernel to srt.utils (#10776)
2025-09-22 23:00:36 -07:00
..
eval
Minor style fixes for sgl-kernel (#9289)
2025-08-18 09:38:35 -07:00
lang
Move parsers under a single folder (#9912)
2025-09-02 18:25:04 -07:00
srt
Move cached kernel to srt.utils (#10776)
2025-09-22 23:00:36 -07:00
test
[2/2] Support deterministic inference for temperature > 0 (#10678)
2025-09-21 19:36:08 -07:00
__init__.py
Refactor the docs (#9031)
2025-08-10 19:49:45 -07:00
bench_offline_throughput.py
Feature/modelscope model download (#8083)
2025-07-31 17:29:31 -07:00
bench_one_batch_server.py
[bench] Fix random seed in bench_one_batch_server (#10548)
2025-09-17 19:30:32 +08:00
bench_one_batch.py
Adds initialize_moe_config to bench_one_batch so MOE backend is respected (#9670)
2025-08-29 17:29:32 -07:00
bench_serving.py
[Feature] Speculative decoding support lookahead (#9873)
2025-09-18 16:42:41 -07:00
check_env.py
Revert "feat: replace Decord with video_reader-rs" (#8077)
2025-07-15 20:04:56 -07:00
compile_deep_gemm.py
[bugfix] Add 'disaggregation_mode' parameter to warmup function when compile deep_gemm manually (#8618)
2025-08-01 16:02:53 -07:00
environ.py
Use simulate acc len from sglang.environ (#10771)
2025-09-23 12:59:50 +08:00
global_config.py
Convert FLASHINFER_WORKSPACE_SIZE to integer (#10731)
2025-09-22 00:26:42 -07:00
launch_server.py
Use simulate acc len from sglang.environ (#10771)
2025-09-23 12:59:50 +08:00
profiler.py
Fix --dataset-path in bench_one_batch_server (#10475)
2025-09-16 02:55:02 +08:00
README.md
Run tests based on labels (#10456)
2025-09-15 00:29:20 -07:00
utils.py
Move cached kernel to srt.utils (#10776)
2025-09-22 23:00:36 -07:00
version.py
chore: bump v0.5.3rc0 (#10468)
2025-09-15 03:55:18 -07:00

README.md

Code Structure

  • eval: The evaluation utilities.
  • lang: The frontend language.
  • srt: The backend engine for running local models. (SRT = SGLang Runtime).
  • test: The test utilities.
  • api.py: The public APIs.
  • bench_offline_throughput.py: Benchmark the performance in the offline mode.
  • bench_one_batch.py: Benchmark the latency of running a single static batch without a server.
  • bench_one_batch_server.py: Benchmark the latency of running a single batch with a server.
  • bench_serving.py: Benchmark online serving with dynamic requests.
  • check_env.py: Check the environment variables and dependencies.
  • global_config.py: The global configs and constants.
  • launch_server.py: The entry point for launching a local server.
  • utils.py: Common utilities.
  • version.py: Version info.