sherie f86596a66c allgather use fusedop. (#2689) ...

### What this PR does / why we need it?
Use 'npu_moe_init_routing_v2' &'npu_moe_token_unpermute' repalce
'npu_moe_init_routing' &‘npu_moe_compute_expert_tokens’&
'npu_moe_finalize_routing' to optimize performance
### Does this PR introduce _any_ user-facing change?
| branch| tps| TTFT |TPOT |
| --- | --- | --- |--- |
|main  |733.98  | 280.05 |34.30 |
|main+fusedop  | 740.33 | 273.34 |33.99 |
### How was this patch tested?


- vLLM version: v0.10.1.1
- vLLM main:
6997a25ac6

Signed-off-by: wangxiaoxin-sherie <wangxiaoxin7@huawei.com>
Co-authored-by: wangxiaoxin-sherie <wangxiaoxin7@huawei.com>

2025-09-04 11:56:29 +08:00

..

attention

[BugFix][MLA] Fix attn_mask bug for ring mla (#2704)

2025-09-04 10:22:46 +08:00

compilation

[Bugfix] Fix aclgraph not enabled by default (#2590)

2025-08-28 14:08:31 +08:00

core

[Bugfix][APC] Fix accuracy issue on prefix caching with AscendScheduler (#2714)

2025-09-04 08:22:46 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[P/D]mooncake_connector adapted to 0.10.1 (#2664)

2025-09-04 08:22:10 +08:00

lora

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

models

[1/N][Draft][Refactor]torchair pangu_moe modeling refactor (#2437)

2025-09-04 10:39:21 +08:00

multistream

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

ops

allgather use fusedop. (#2689)

2025-09-04 11:56:29 +08:00

patch

[Bugfix][LoRA][Operator] Fix LoRA custom operators accuracy issue (#2672)

2025-09-02 11:46:59 +08:00

quantization

[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC quantized MoE layers (#2275)

2025-09-04 11:37:32 +08:00

sample

Support v0.10.1 (#2584)

2025-08-28 18:47:53 +08:00

spec_decode

[Refactor] Refactor Spec Decode (#2668)

2025-09-04 11:34:47 +08:00

torchair

[1/N][Refactor][Quantization] remove redundant quantizer class (#2680)

2025-09-04 11:35:14 +08:00

worker

[Refactor] Refactor Spec Decode (#2668)

2025-09-04 11:34:47 +08:00

__init__.py

Bump torch version to 2.7.1 (#1562)

2025-08-05 08:43:24 +08:00

ascend_config.py

[bugfix] fix torchair runtime error caused by configuration mismtaches and file missing (#2532)

2025-09-03 17:56:12 +08:00

ascend_forward_context.py

[Refactor][MoE] remove redundant code after refactoring fused_moe (#2612)

2025-08-30 22:28:50 +08:00

envs.py

[P/D]mooncake_connector adapted to 0.10.1 (#2664)

2025-09-04 08:22:10 +08:00

meta_registration.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

platform.py

[Feat] allow using aclgraph in ray backend (#2589)

2025-09-04 11:45:56 +08:00

utils.py

[Fix] fix resources limit error when apply speculative decoding and aclgraph (#2472)

2025-09-04 11:50:43 +08:00