Li Wang 30bf7014d0 [Bugfix] Add func swap_states to fix MLA attention (#1580) ...

### What this PR does / why we need it?
mla attention still using the gpu_input_batch's attr:`swap_states`, which will lead to
an error `AttributeError: 'InputBatch' object has no attribute 'swap_states'`

This PR fixed the mla input patch error
### How was this patch tested?
will be tested by #1136

---------

Signed-off-by: wangli <wangli858794774@gmail.com>

2025-07-02 17:42:53 +08:00

..

__init__.py

[Bugfix] Add func swap_states to fix MLA attention (#1580)

2025-07-02 17:42:53 +08:00

metadata.py

[V1][ModelRunner] Support pooling model for v1 engine (#1359)

2025-06-30 16:31:12 +08:00