rjg-lyh 3af91e5ac4 [Bugfix] Fix the input constraints checks for the mlapo and bmm_transpose operators (#5764) ...

### What this PR does / why we need it?
This PR fix the input constraints checks for the mlapo and bmm_transpose
operators.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
CI passed with new added/existing test.

- vLLM version: v0.13.0
- vLLM main:
2f4e6548ef

### Perf
64K/3K，1P1D，bs=32

before this pr:
TPOT 29ms, TTFT 47s，TPS 606 token/s

after this pr:
TPOT 29ms, TTFT 48s，TPS 636 token/s

Signed-off-by: rjg-lyh <1318825571@qq.com>

2026-01-16 09:52:48 +00:00

..

e2e

[CI] Add DeepSeek-V3.2-W8A8-Pruning e2e test (#5922)

2026-01-16 15:49:57 +08:00

ut

[Bugfix] Fix the input constraints checks for the mlapo and bmm_transpose operators (#5764)

2026-01-16 09:52:48 +00:00

__init__.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00