Chang Su 28b26dbf48 [Bugfix]: fix missing queue_time_start for requests from grammar_queue (#5696)

2025-04-29 17:31:44 -07:00

..

multimodal_processors

Bugfix for minicpmo vision test (#5760)

2025-04-26 23:18:02 +08:00

cache_controller.py

Large page size aligned hierarchical caching (#4581)

2025-04-01 22:38:15 -07:00

configure_logging.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

data_parallel_controller.py

Integrating PD disaggregation with DP attention and DeepEP (#5435)

2025-04-23 01:46:01 -07:00

detokenizer_manager.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

expert_distribution.py

Support compressed tensors fp8w8a8 (#4743)

2025-03-26 13:21:25 -07:00

io_struct.py

[PD]: Support Muti Prefill in one node (#5704)

2025-04-26 00:30:47 +08:00

mm_utils.py

vlm: enable radix cache for qwen-vl models (#5349)

2025-04-23 20:35:05 -07:00

multimodal_processor.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

schedule_batch.py

Add Cutlass MLA attention backend (#5390)

2025-04-27 20:58:53 -07:00

schedule_policy.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

scheduler_output_processor_mixin.py

Improve overlap scheduling (#5788)

2025-04-28 11:19:16 +08:00

scheduler.py

[Bugfix]: fix missing queue_time_start for requests from grammar_queue (#5696)

2025-04-29 17:31:44 -07:00

session_controller.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

tokenizer_manager.py

[PD]: Support Muti Prefill in one node (#5704)

2025-04-26 00:30:47 +08:00

tp_worker_overlap_thread.py

Improve overlap scheduling (#5788)

2025-04-28 11:19:16 +08:00

tp_worker.py

Auto set draft model path for MTP (#5793)

2025-04-29 16:25:40 -07:00

utils.py

refactor: multimodal data (#4754)

2025-03-31 09:57:51 -07:00