realliujiaxu bedf223771 [Perf] move quant before allgather in Allgather EP (#3420) ...

### What this PR does / why we need it?
move quant before allgather in Allgather EP, rely on
https://github.com/vllm-project/vllm-ascend/pull/3334

Deepseek R1 W8A8 performance on A2 with
`HCCL_ALGO="level0:NA;level1:pipeline"`:
| Seq length | Mean TTFT (ms) main | Mean TTFT (ms)  this PR |
|----------|----------|----------|
| 4k   |  375.21  | 364.99   |
| 16k  | 1465.23   | 1421.75  |
### Does this PR introduce _any_ user-facing change?

### How was this patch tested?


- vLLM version: v0.11.0
- vLLM main:
83f478bb19

---------

Signed-off-by: realliujiaxu <realliujiaxu@163.com>

2025-11-04 16:49:58 +08:00

..

attention

Upgrade CANN to 8.3.rc1 (#3945)

2025-11-03 20:21:07 +08:00

compilation

[Test]Add unit test for compilation/acl_graph.py (#3039)

2025-09-19 21:31:17 +08:00

core

Upgrade to new vllm commit (#3719)

2025-10-25 15:36:32 +08:00

device_allocator

add ut for device allocator/camem and mutistream/layers (#2037)

2025-07-31 19:17:27 +08:00

distributed

[Bugfix] TP size larger than KV cache head causes accuracy issues (#3366)

2025-10-11 11:22:23 +08:00

eplb

[CI]Add EPLB CI. (#3568)

2025-10-21 22:58:02 +08:00

fake_weight

[CI] Add unit test framework (#1201)

2025-06-16 18:32:28 +08:00

kv_connector

[bugfix] layerwise D first plan (#3866)

2025-10-30 22:20:34 +08:00

model_loader/netloader

Upgrade to new vllm commit (#3719)

2025-10-25 15:36:32 +08:00

models

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00

ops

[Perf] move quant before allgather in Allgather EP (#3420)

2025-11-04 16:49:58 +08:00

patch/worker/patch_common

[Refactor] refactor patch module (#3555)

2025-10-21 20:19:46 +08:00

quantization

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00

sample

[UT] Fix test_sample_recovered_tokens_pytorch_autoregressive (#3434)

2025-10-24 11:20:57 +08:00

torchair

Update torch-npu version to 2.7.1 (#3896)

2025-10-31 17:16:31 +08:00

worker

[Perf] Delete redundant operations in model_runner and forward_context (#3677)

2025-10-29 15:59:55 +08:00

__init__.py

[2/4][Refactor] Refactor torchair utils (#1892)

2025-07-21 19:43:30 +08:00

base.py

[Feature]: implement the fusion of allreduce and matmul in prefill phase when tp is enabled (#1926)

2025-07-28 15:13:37 +08:00

conftest.py

[1/N][CustomOp] Register activation customop instead of overwrite forward_oot (#1841)

2025-07-18 23:07:14 +08:00

test_ascend_config.py

[Feature] Support moe multi-stream for aclgraph. (#2946)

2025-09-19 11:06:45 +08:00

test_envs.py

[Misc] Remove redundant imported envs, using envs_ascend instead (#2193)

2025-08-14 09:33:39 +08:00

test_platform.py

[UT] fix skip ut test for test_utils (#3803)

2025-10-30 15:52:53 +08:00

test_utils.py

[UT] fix skip ut test for test_utils (#3803)

2025-10-30 15:52:53 +08:00