Zetong Li 6e72bfdc50 [v0.11.0] cherry-pick Fix performance degradation when mtp>1 (#3597) (#3630) ...

### What this PR does / why we need it?
cherry-pick Fix performance degradation when mtp>1 (#3597)

This PR aims to fix performance degradation when mtp>1. Since mtp>1 may
result in more tokens (i.e. larger batch size) than acl graph maximum
batch size, this will cause draft model to run in eager mode.

### How was this patch tested?
by ci

---------

Signed-off-by: Zetong Li <slippersss@126.com>

2025-10-22 22:07:39 +08:00

..

e2e

[CI]Add EPLB CI. (#3568)

2025-10-21 22:58:02 +08:00

ut

[v0.11.0] cherry-pick Fix performance degradation when mtp>1 (#3597) (#3630)

2025-10-22 22:07:39 +08:00

__init__.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00