shangmingc ffde65a094 [PD] Fix dynamic port support and MLA buffer for Mooncake (#5415) ...

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>

2025-04-15 19:29:31 +08:00

..

multimodal_processors

[VLM] Adopt fast image processor by default (#5065)

2025-04-11 21:46:58 -07:00

cache_controller.py

Large page size aligned hierarchical caching (#4581)

2025-04-01 22:38:15 -07:00

configure_logging.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

data_parallel_controller.py

Fix data parallel + tensor parallel (#4499)

2025-03-17 05:13:16 -07:00

detokenizer_manager.py

[Minor] more code cleanup (#4077)

2025-03-04 21:23:47 -08:00

expert_distribution.py

Support compressed tensors fp8w8a8 (#4743)

2025-03-26 13:21:25 -07:00

io_struct.py

Support server based rollout in Verlengine (#4848)

2025-04-12 10:07:52 -07:00

mm_utils.py

model: support mllama4 (#5144)

2025-04-09 09:28:44 -07:00

multimodal_processor.py

refactor: multimodal data (#4754)

2025-03-31 09:57:51 -07:00

schedule_batch.py

[PD] Add transfer backend abstraction (#5328)

2025-04-14 01:39:39 +08:00

schedule_policy.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

scheduler_output_processor_mixin.py

Fix the output of hidden states after HTTP requests (#4269)

2025-03-13 14:54:06 -07:00

scheduler.py

[PD] Fix dynamic port support and MLA buffer for Mooncake (#5415)

2025-04-15 19:29:31 +08:00

session_controller.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

tokenizer_manager.py

[PD] Add transfer backend abstraction (#5328)

2025-04-14 01:39:39 +08:00

tp_worker_overlap_thread.py

Remove redundant type conversion (#4513)

2025-03-17 05:57:35 -07:00

tp_worker.py

Support --enable-llama4-multimodal (#5254)

2025-04-11 01:24:14 -07:00

utils.py

refactor: multimodal data (#4754)

2025-03-31 09:57:51 -07:00