Ke Bao 424591d53d Fix spec filter batch when target extend (#10991)

2025-09-30 14:44:02 +08:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

cache_controller.py

[HiCache]: Support dynamic loading backends for hicache (#10551)

2025-09-26 18:34:11 -07:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

detokenizer_manager.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

Use more general heuristics to set the default value of --mem-fraction-static (#10975)

2025-09-29 10:11:03 -07:00

mm_utils.py

model: support qwen3-vl series (#10323)

2025-09-23 10:15:52 -07:00

multi_tokenizer_mixin.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

multimodal_processor.py

Fix multimodal registry and code sync scripts (#10759)

2025-09-22 15:36:01 -07:00

overlap_utils.py

Introduce FutureMap (#10715)

2025-09-22 23:27:30 -07:00

schedule_batch.py

Fix spec filter batch when target extend (#10991)

2025-09-30 14:44:02 +08:00

schedule_policy.py

Refactors radix cache for extra key support (#10317)

2025-09-22 02:16:16 +08:00

scheduler_input_blocker.py

Support colocating requests (#7973)

2025-07-28 22:51:49 -07:00

scheduler_metrics_mixin.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

scheduler_output_processor_mixin.py

[PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192)

2025-09-25 23:20:49 -07:00

scheduler_profiler_mixin.py

Fix profiler (#10997)

2025-09-27 14:56:18 -07:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_update_weights_mixin.py

[RL] Add destroy process group api (#9979)

2025-09-19 00:31:56 +08:00

scheduler.py

[speculative decoding] rename lookahead to ngram (#11010)

2025-09-28 21:06:59 -07:00

session_controller.py

Fix DP load for embedding (#9165)

2025-08-15 23:58:44 -07:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

[RL] Add destroy process group api (#9979)

2025-09-19 00:31:56 +08:00

tokenizer_manager.py

Rename customer label -> custom label (#10899)

2025-09-25 16:19:53 -07:00

tp_worker_overlap_thread.py

Introduce FutureMap (#10715)

2025-09-22 23:27:30 -07:00

tp_worker.py

refactor loading weights from remote instance coding format (#10941)

2025-09-26 15:25:39 -07:00

utils.py

[PD] Support PD disaggregation with Prefill PP (#8846)

2025-08-16 18:31:31 -07:00