whx 3393d53b36 [Scheduler][MTP] Add support for speculative decoding in AsecendScheduler. (#943) ...

This PR adds support for speculative decoding in AsecendScheduler.
Also inculde part of support for disaggregated prefill, full support
will be merged in follow-up PR.

---------

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-06-11 20:55:44 +08:00

..

compile

[CI] Upgrade vllm to 0.9.1 (#1165)

2025-06-11 16:33:11 +08:00

core

[Scheduler][MTP] Add support for speculative decoding in AsecendScheduler. (#943)

2025-06-11 20:55:44 +08:00

ops

[CI] Refactor CI (#952)

2025-05-28 06:31:35 +08:00

sample

[CI] Refactor CI (#952)

2025-05-28 06:31:35 +08:00

__init__.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00

test_aclgraph.py

[Misc] Refactor additional_config (#1029)

2025-06-05 16:28:01 +08:00

test_ascend_config.py

Support multistream of shared experts in FusedMoE (#997)

2025-06-11 09:18:38 +08:00

test_camem.py

[Worker][V1] Support sleep mode for v1 (#1084)

2025-06-06 21:54:02 +08:00

test_guided_decoding.py

[CI]Add guided decoding test (#422)

2025-04-22 17:50:06 +08:00

test_ilama_lora.py

[V1][LoRA][Test] V1 Engine LoRA support & e2e test (#893)

2025-05-22 19:20:51 +08:00

test_offline_inference.py

[CI] rename Qwen2.5-0.5B-Instruct-W8A8 model (#1145)

2025-06-11 06:18:32 +08:00

test_profile_execute_duration.py

[ModelRunner]Add profile execute duration observation (#1013)

2025-06-06 09:29:34 +08:00

test_prompt_embedding.py

[ModelRunner] Support embedding inputs (#916)

2025-06-06 20:21:13 +08:00

test_pyhccl.py

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00

test_sampler.py

optimize the funtion of computing topk and topp in sampler. (#970)

2025-06-05 16:42:18 +08:00

test_scheduler.py

[CI] Upgrade vllm to 0.9.1 (#1165)

2025-06-11 16:33:11 +08:00