huangtingwei cb9e0e4180 [HiCacheStorage] fix abort request host memory leaks (#9874) ...

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

2025-09-01 18:59:29 -07:00

..

cache_controller.py

[HiCache] Storage Refactoring (#9797)

2025-08-31 22:58:21 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[feat] support minimum token load balance in dp attention (#7379)

2025-08-03 00:46:47 -07:00

detokenizer_manager.py

Support Multi Process Tokenizer Manager(#6555) (#8964)

2025-09-01 01:00:13 -07:00

io_struct.py

Support Multi Process Tokenizer Manager(#6555) (#8964)

2025-09-01 01:00:13 -07:00

mm_utils.py

[feat]Ascend NPU Gemma-3-12b and Gemma-3-27b support (#8909)

2025-08-31 00:25:07 -07:00

multi_tokenizer_mixin.py

Support Multi Process Tokenizer Manager(#6555) (#8964)

2025-09-01 01:00:13 -07:00

multimodal_processor.py

Fix CI (#9012)

2025-08-09 13:33:42 -07:00

schedule_batch.py

Add enable_flashinfer_mxfp4_bf16_moe for higher precision and slower moe backend (#9004)

2025-08-23 15:38:40 +08:00

schedule_policy.py

Fix docs for clip max new tokens (#9082)

2025-08-11 13:15:21 -07:00

scheduler_input_blocker.py

Support colocating requests (#7973)

2025-07-28 22:51:49 -07:00

scheduler_metrics_mixin.py

[PD] Improve disaggregation metrics output: update the metrics to keep reflecting real stats (#7317)

2025-08-24 23:16:43 -07:00

scheduler_output_processor_mixin.py

Fix input logprob index (#9841)

2025-08-31 02:56:47 -07:00

scheduler_profiler_mixin.py

[feat] Enable Ascend profiling on SGLang (#8610)

2025-08-12 13:28:31 -07:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_update_weights_mixin.py

feat(draft_model): support draft_model for RemoteModelLoader (#6407)

2025-08-28 16:09:52 -07:00

scheduler.py

[HiCacheStorage] fix abort request host memory leaks (#9874)

2025-09-01 18:59:29 -07:00

session_controller.py

Fix DP load for embedding (#9165)

2025-08-15 23:58:44 -07:00

template_manager.py

Fix incorrect logic in chat template handling. (#9336)

2025-08-20 16:25:36 -07:00

tokenizer_manager.py

Support Multi Process Tokenizer Manager(#6555) (#8964)

2025-09-01 01:00:13 -07:00

tp_worker_overlap_thread.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

tp_worker.py

Overlapped weight offload (#8034)

2025-08-23 02:06:46 -07:00

utils.py

[PD] Support PD disaggregation with Prefill PP (#8846)

2025-08-16 18:31:31 -07:00