Binyao Jiang 66d6be0874 Bug fix: use correct mm_items in embed_mm_inputs (#8893)

2025-08-16 19:55:56 -07:00

..

cache_controller.py

fix io group (#9154)

2025-08-14 12:46:42 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[feat] support minimum token load balance in dp attention (#7379)

2025-08-03 00:46:47 -07:00

detokenizer_manager.py

bugfix: Fix output_ids extraction in detokenizer_manager (#9047)

2025-08-11 03:17:32 -07:00

io_struct.py

Fix DP load for embedding (#9165)

2025-08-15 23:58:44 -07:00

mm_utils.py

Bug fix: use correct mm_items in embed_mm_inputs (#8893)

2025-08-16 19:55:56 -07:00

multimodal_processor.py

Fix CI (#9012)

2025-08-09 13:33:42 -07:00

schedule_batch.py

Add fp4 quantize before all-gather for Flashinfer cutlass MoE DP (max throughput) (#7667)

2025-08-15 22:08:11 -07:00

schedule_policy.py

Fix docs for clip max new tokens (#9082)

2025-08-11 13:15:21 -07:00

scheduler_input_blocker.py

Support colocating requests (#7973)

2025-07-28 22:51:49 -07:00

scheduler_metrics_mixin.py

Split the scheduler into multiple mixin classes to reduce the file size (#8483)

2025-07-29 12:46:50 -07:00

scheduler_output_processor_mixin.py

Support v1/responses and use harmony in serving_chat (#8837)

2025-08-06 16:20:34 -07:00

scheduler_profiler_mixin.py

[feat] Enable Ascend profiling on SGLang (#8610)

2025-08-12 13:28:31 -07:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_update_weights_mixin.py

[RL] fix skip_server_warmup and rl health_generate logic (#8757)

2025-08-08 04:34:38 -07:00

scheduler.py

[PD] Support PD disaggregation with Prefill PP (#8846)

2025-08-16 18:31:31 -07:00

session_controller.py

Fix DP load for embedding (#9165)

2025-08-15 23:58:44 -07:00

template_manager.py

Enables force reasoning based on chat template for Qwen3-Thinking (#8369)

2025-08-06 20:02:47 -07:00

tokenizer_manager.py

feat: Add model version tracking with API endpoints and response metadata (#8795)

2025-08-14 12:13:46 -07:00

tp_worker_overlap_thread.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

tp_worker.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

utils.py

[PD] Support PD disaggregation with Prefill PP (#8846)

2025-08-16 18:31:31 -07:00