Liangsheng Yin 25e7dbe8af Fix ngram spec with page size > 1 (#11135)

2025-10-02 12:34:23 +08:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

cache_controller.py

[HiCache] Configurable and Dynamic Prefetch Timeout (#10512)

2025-10-01 08:44:10 -05:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

detokenizer_manager.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

Use more general heuristics to set the default value of --mem-fraction-static (#10975)

2025-09-29 10:11:03 -07:00

mm_utils.py

model: support qwen3-vl series (#10323)

2025-09-23 10:15:52 -07:00

multi_tokenizer_mixin.py

[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)

2025-09-15 10:06:08 +08:00

multimodal_processor.py

Fix multimodal registry and code sync scripts (#10759)

2025-09-22 15:36:01 -07:00

overlap_utils.py

Introduce FutureMap (#10715)

2025-09-22 23:27:30 -07:00

schedule_batch.py

Fix ngram spec with page size > 1 (#11135)

2025-10-02 12:34:23 +08:00

schedule_policy.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

scheduler_input_blocker.py

Support colocating requests (#7973)

2025-07-28 22:51:49 -07:00

scheduler_metrics_mixin.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

scheduler_output_processor_mixin.py

Remove debug print statement from scheduler output (#11145)

2025-10-01 13:37:05 -07:00

scheduler_profiler_mixin.py

Fix profiler (#10997)

2025-09-27 14:56:18 -07:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_update_weights_mixin.py

[RL] Add destroy process group api (#9979)

2025-09-19 00:31:56 +08:00

scheduler.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

session_controller.py

Fix DP load for embedding (#9165)

2025-08-15 23:58:44 -07:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

tokenizer_manager.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

tp_worker_overlap_thread.py

Introduce FutureMap (#10715)

2025-09-22 23:27:30 -07:00

tp_worker.py

refactor loading weights from remote instance coding format (#10941)

2025-09-26 15:25:39 -07:00

utils.py

[PD] Support PD disaggregation with Prefill PP (#8846)

2025-08-16 18:31:31 -07:00