ronnie_zheng 1e0e549766 Ascend attention backend(PA&MLA) (#7722) ...

Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>

2025-07-03 09:23:19 -07:00

..

cache_controller.py

[minor] simplify the TokenToKVPoolAllocator (#7414)

2025-06-22 12:37:18 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

feat: add direct routing strategy to DP worker (#6884)

2025-06-09 11:44:05 -07:00

detokenizer_manager.py

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

io_struct.py

Support updating weights at once by stopping all requests (#6698)

2025-07-02 22:26:06 -07:00

mm_utils.py

Refactor mm processors and Enable mixed modality processing (#7629)

2025-06-30 23:14:48 -07:00

multimodal_processor.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

schedule_batch.py

Ascend attention backend(PA&MLA) (#7722)

2025-07-03 09:23:19 -07:00

schedule_policy.py

Fix prefill OOM due to wrong token calculation when page > 1 (#7397)

2025-06-24 02:12:29 +08:00

scheduler_output_processor_mixin.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

scheduler.py

Fix num_tokens_pre_allocated in disaggregation log (#7714)

2025-07-02 22:31:49 -07:00

session_controller.py

Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136)

2025-05-16 12:26:15 -07:00

template_manager.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

tokenizer_manager.py

Support updating weights at once by stopping all requests (#6698)

2025-07-02 22:26:06 -07:00

tp_worker_overlap_thread.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

tp_worker.py

[RL] support update_weights_from_distributed with different group and multiple weights (#7292)

2025-07-02 19:29:11 -07:00

utils.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00