whx a58ff9e92f [Cherry-pick] Port MoE multi-stream fix to v0.11.0-dev (#3753) ...

This PR moves the communication operation of shared experts out of extra
stream because I found that this might cause rtMemcpy related errors
when running shared experts multistream with aclgraph.

Furthermore, I utilize a global variable as extra stream object to avoid
allocating streams for each layer in full-graph mode.

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-10-25 15:51:43 +08:00

..

attention

[v0.11.0][Perf] Eliminating the zerolike operator through patch (#3632)

2025-10-23 14:49:28 +08:00

compilation

[Feat]Make full graph mode compalible with MTP (#3276)

2025-10-17 20:19:56 +08:00

core

[BugFix][Cherry-pick] Cherry-pick PR 3675 to v0.11.0-dev (#3732)

2025-10-25 09:41:51 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[0.11.0] cherry-pick from #3747 (#3746)

2025-10-25 14:21:30 +08:00

eplb

[CI]Add EPLB CI. (#3568)

2025-10-21 22:58:02 +08:00

lora

[Bugfix][LoRA] Fix forward error and shape mismatch when using LoRA (#3153)

2025-09-28 17:30:50 +08:00

models

Revert "[Feat] Shared expert dp for deepseek and deepseek_mtp (#3495)" (#3586)

2025-10-21 22:24:30 +08:00

multistream

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

ops

[Cherry-pick] Port MoE multi-stream fix to v0.11.0-dev (#3753)

2025-10-25 15:51:43 +08:00

patch

[cherry-pick]【main】patch sched_yield (#3648) (#3687)

2025-10-24 00:24:58 +08:00

quantization

[v0.11.0][bugfix] Add 'layer_type' param to get_pergroup_param() for compatibility (#3684)

2025-10-23 21:26:50 +08:00

sample

Drop 0.10.2 (#3284)

2025-10-09 10:28:38 +08:00

spec_decode

unify logic between aclgraph and torchair (#3602)

2025-10-22 21:55:06 +08:00

torchair

[BugFix] Check all expert maps when using muilty instance. (#3662)

2025-10-24 17:10:31 +08:00

worker

[v0.11.0][Fix] Cap max tokens to prevent potential OOM (#3720) (#3744)

2025-10-25 15:46:56 +08:00

__init__.py

[Refactor] Adapt deepseek-v3.2 to vllm 0.11.0 (#3432)

2025-10-15 17:48:58 +08:00

ascend_config.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

ascend_forward_context.py

[Bugfix] fix logging and d2h bug for flash comm1 (#3505)

2025-10-17 21:13:41 +08:00

cpu_binding.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

envs.py

[Feat] Flash comm allgher ep (#3334)

2025-10-15 19:36:32 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

Revert "[Feat] Shared expert dp for deepseek and deepseek_mtp (#3495)" (#3586)

2025-10-21 22:24:30 +08:00

utils.py

[Cherry-pick] Port MoE multi-stream fix to v0.11.0-dev (#3753)

2025-10-25 15:51:43 +08:00