NeverRaR df84cceca8 perf: use multicast to avoid padding decode request to prefill size (#1555) ...

### What this PR does / why we need it?
perf: use multicast to avoid padding decode request to prefill size

### How was this patch tested?

- vLLM version: v0.9.1
- vLLM main:
1fd471e957

Signed-off-by: boying <897013703@qq.com>

2025-07-07 22:36:03 +08:00

..

attention

[BugFix] Fix max_num_tokens_across_dp calculation bugs in attention_v1_torchair (#1636)

2025-07-07 20:03:02 +08:00

compilation

[CI] Upgrade vllm to 0.9.1 (#1165)

2025-06-11 16:33:11 +08:00

core

[ModelRunner] Use shared CachedRequestData cross request to fix ci (#1546)

2025-07-02 06:05:21 +08:00

device_allocator

[Build] Add build info (#1386)

2025-06-27 09:14:43 +08:00

distributed

[bugfix] some bugs maybe fail to run (#896)

2025-06-03 11:07:33 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

[CORE]initial support for torchair with non-mla backend (#1506)

2025-07-03 22:21:42 +08:00

multistream

[perf]: support dual-batch overlap(dbo) for deepseek (#941)

2025-06-07 16:46:58 +08:00

ops

perf: use multicast to avoid padding decode request to prefill size (#1555)

2025-07-07 22:36:03 +08:00

patch

[CORE]initial support for torchair with non-mla backend (#1506)

2025-07-03 22:21:42 +08:00

pool

[Bugfix] Add func swap_states to fix MLA attention (#1580)

2025-07-02 17:42:53 +08:00

quantization

perf: use multicast to avoid padding decode request to prefill size (#1555)

2025-07-07 22:36:03 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[Performance] Disable JIT and nd2nz to improve performance for Altlas 300I series (#1591)

2025-07-05 16:29:21 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

ascend_config.py

[CI] Follow vLLM FusedMoEParallelConfig interface change and clean up unused config (#1625)

2025-07-04 17:54:33 +08:00

envs.py

support fused_moe_allgather_ep (#1335)

2025-06-23 22:03:38 +08:00

platform.py

[CORE]initial support for torchair with non-mla backend (#1506)

2025-07-03 22:21:42 +08:00

utils.py

perf: use multicast to avoid padding decode request to prefill size (#1555)

2025-07-07 22:36:03 +08:00