[Cherry-pick]bmm_transpose to v011dev (#3995)

### What this PR does / why we need it?
Add a custom op to acclerater the deepseek model. The fusion ops combine
the bmm and transpose together, which is applied to mla module.
Cherry-pick from this commtid c68ddc11ce

### Does this PR introduce _any_ user-facing change?
No

---------

Signed-off-by: hust17yixuan <303660421@qq.com>
This commit is contained in:
Wang Yixuan
2025-12-08 19:22:14 +08:00
committed by GitHub
parent 6391f0625f
commit d412565ec9
15 changed files with 1736 additions and 13 deletions

View File

@@ -158,4 +158,13 @@ namespace vllm_ascend {
void* tiling,
const uint32_t block_dim
);
extern void batch_matmul_transpose_impl(
void* stream,
void* gm_a,
void* gm_b,
void* gm_c,
void* gm_tiling_data,
const uint32_t block_dim
);
}