Li Wang 30bf7014d0 [Bugfix] Add func swap_states to fix MLA attention (#1580) ...

### What this PR does / why we need it?
mla attention still using the gpu_input_batch's attr:`swap_states`, which will lead to
an error `AttributeError: 'InputBatch' object has no attribute 'swap_states'`

This PR fixed the mla input patch error
### How was this patch tested?
will be tested by #1136

---------

Signed-off-by: wangli <wangli858794774@gmail.com>

2025-07-02 17:42:53 +08:00

..

attention

[Bugfix] Add func swap_states to fix MLA attention (#1580)

2025-07-02 17:42:53 +08:00

compilation

[CI] Upgrade vllm to 0.9.1 (#1165)

2025-06-11 16:33:11 +08:00

core

[ModelRunner] Use shared CachedRequestData cross request to fix ci (#1546)

2025-07-02 06:05:21 +08:00

device_allocator

[Build] Add build info (#1386)

2025-06-27 09:14:43 +08:00

distributed

[bugfix] some bugs maybe fail to run (#896)

2025-06-03 11:07:33 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

support pangumoe w8a8c8 and docs (#1477)

2025-06-28 18:51:07 +08:00

multistream

[perf]: support dual-batch overlap(dbo) for deepseek (#941)

2025-06-07 16:46:58 +08:00

ops

[PERF]support MERRouter (#1421)

2025-06-28 16:14:49 +08:00

patch

[BugFix]Fix bugs when initializing communication groups with dp on 300I Duo (#1478)

2025-06-28 16:07:52 +08:00

pool

[Bugfix] Add func swap_states to fix MLA attention (#1580)

2025-07-02 17:42:53 +08:00

quantization

Fix W8A8 fused moe bug (#1529)

2025-07-02 16:40:51 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[Bugfix] Add func swap_states to fix MLA attention (#1580)

2025-07-02 17:42:53 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

ascend_config.py

[CI] Add unit test framework (#1201)

2025-06-16 18:32:28 +08:00

envs.py

support fused_moe_allgather_ep (#1335)

2025-06-23 22:03:38 +08:00

platform.py

support pangumoe w8a8c8 and docs (#1477)

2025-06-28 18:51:07 +08:00

utils.py

[Build] Add build info (#1386)

2025-06-27 09:14:43 +08:00