Zetong Li 6e72bfdc50 [v0.11.0] cherry-pick Fix performance degradation when mtp>1 (#3597) (#3630) ...

### What this PR does / why we need it?
cherry-pick Fix performance degradation when mtp>1 (#3597)

This PR aims to fix performance degradation when mtp>1. Since mtp>1 may
result in more tokens (i.e. larger batch size) than acl graph maximum
batch size, this will cause draft model to run in eager mode.

### How was this patch tested?
by ci

---------

Signed-off-by: Zetong Li <slippersss@126.com>

2025-10-22 22:07:39 +08:00

..

attention

[Model][2/N] Remove deepseek_mtp modeling. (#3561)

2025-10-21 20:17:09 +08:00

compilation

[Test]Add unit test for compilation/acl_graph.py (#3039)

2025-09-19 21:31:17 +08:00

core

[UT] fix skip ut test and enable ut test run normally (#3410)

2025-10-20 16:30:57 +08:00

device_allocator

add ut for device allocator/camem and mutistream/layers (#2037)

2025-07-31 19:17:27 +08:00

distributed

[Bugfix] TP size larger than KV cache head causes accuracy issues (#3366)

2025-10-11 11:22:23 +08:00

eplb

[CI]Add EPLB CI. (#3568)

2025-10-21 22:58:02 +08:00

fake_weight

[CI] Add unit test framework (#1201)

2025-06-16 18:32:28 +08:00

kv_connector

[v0.11.0]cherry-pick fix ut (#3608) (#3614)

2025-10-22 14:14:15 +08:00

models

fix vl float model not support NZ format weight error (#3533)

2025-10-21 22:23:17 +08:00

multistream

add ut for device allocator/camem and mutistream/layers (#2037)

2025-07-31 19:17:27 +08:00

ops

Revert "[Feat] Shared expert dp for deepseek and deepseek_mtp (#3495)" (#3586)

2025-10-21 22:24:30 +08:00

patch/worker/patch_common

[Refactor] refactor patch module (#3555)

2025-10-21 20:19:46 +08:00

quantization

[Feat][quantization] Support new version w4a8 dynamic quantization for Linear layers (#3311)

2025-10-21 20:18:39 +08:00

sample

[main] add pd transfer for ascend scheduler (#2753)

2025-09-10 08:46:39 +08:00

torchair

[v0.11.0]cherry-pick fix ut (#3608) (#3614)

2025-10-22 14:14:15 +08:00

worker

[Fix] Refactor dummy attention metadata creation (#3497)

2025-10-21 00:00:42 +08:00

__init__.py

[2/4][Refactor] Refactor torchair utils (#1892)

2025-07-21 19:43:30 +08:00

base.py

[Feature]: implement the fusion of allreduce and matmul in prefill phase when tp is enabled (#1926)

2025-07-28 15:13:37 +08:00

conftest.py

[1/N][CustomOp] Register activation customop instead of overwrite forward_oot (#1841)

2025-07-18 23:07:14 +08:00

test_ascend_config.py

[Feature] Support moe multi-stream for aclgraph. (#2946)

2025-09-19 11:06:45 +08:00

test_envs.py

[Misc] Remove redundant imported envs, using envs_ascend instead (#2193)

2025-08-14 09:33:39 +08:00

test_platform.py

[UT] fix skip ut test and enable ut test run normally (#3410)

2025-10-20 16:30:57 +08:00

test_utils.py

[v0.11.0] cherry-pick Fix performance degradation when mtp>1 (#3597) (#3630)

2025-10-22 22:07:39 +08:00