Cheng Wan b87aacb5c5 [DP Attention] Refactor: adding some utility functions (#9136)

2025-08-13 21:08:06 -07:00

..

cache_controller.py

Support page first layout zero copy for mooncake store (#8651)

2025-08-12 15:59:26 -07:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[feat] support minimum token load balance in dp attention (#7379)

2025-08-03 00:46:47 -07:00

detokenizer_manager.py

bugfix: Fix output_ids extraction in detokenizer_manager (#9047)

2025-08-11 03:17:32 -07:00

io_struct.py

Fix race condition in async lora unload (#9084)

2025-08-11 22:59:29 -07:00

mm_utils.py

Fix qwen2 audio not working bug (#8600)

2025-08-09 00:42:29 -07:00

multimodal_processor.py

Fix CI (#9012)

2025-08-09 13:33:42 -07:00

schedule_batch.py

[DP Attention] Refactor: adding some utility functions (#9136)

2025-08-13 21:08:06 -07:00

schedule_policy.py

Fix docs for clip max new tokens (#9082)

2025-08-11 13:15:21 -07:00

scheduler_input_blocker.py

Support colocating requests (#7973)

2025-07-28 22:51:49 -07:00

scheduler_metrics_mixin.py

Split the scheduler into multiple mixin classes to reduce the file size (#8483)

2025-07-29 12:46:50 -07:00

scheduler_output_processor_mixin.py

Support v1/responses and use harmony in serving_chat (#8837)

2025-08-06 16:20:34 -07:00

scheduler_profiler_mixin.py

[feat] Enable Ascend profiling on SGLang (#8610)

2025-08-12 13:28:31 -07:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_update_weights_mixin.py

[RL] fix skip_server_warmup and rl health_generate logic (#8757)

2025-08-08 04:34:38 -07:00

scheduler.py

[Generative Score API] Optimization to Remove Decode. (#8840)

2025-08-14 05:12:24 +08:00

session_controller.py

Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748)

2025-07-04 16:33:33 -07:00

template_manager.py

Enables force reasoning based on chat template for Qwen3-Thinking (#8369)

2025-08-06 20:02:47 -07:00

tokenizer_manager.py

[Generative Score API] Optimization to Remove Decode. (#8840)

2025-08-14 05:12:24 +08:00

tp_worker_overlap_thread.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

tp_worker.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

utils.py

[feat] support minimum token load balance in dp attention (#7379)

2025-08-03 00:46:47 -07:00