Zetong Li b6aa5bbdbf [0.18.0][BugFix] Add PrefillNoCache state in mla _forward_decode for short prompt (#8264) ...

### What this PR does / why we need it?
This PR is cherry-pick from #8263.

This PR aims to fix short prompt problem. The root cause can be found in
#8029. Since the previous pr may miss mixed long and short prompt batch,
after discussion, we decide to add PrefillNoCache state in mla
_forward_decode now instead.

Signed-off-by: Zetong Li <slippersss@126.com>

2026-04-15 09:23:52 +08:00

..

context_parallel

[v0.18.0][BugFix]Revert the code: Replace npu_ring_mla wit FIA with MLA prefill. (#7961)

2026-04-09 17:00:25 +08:00

__init__.py

[Core] Make V1 work and enable V1 engine test (#389)

2025-03-28 19:34:23 +08:00

attention_mask.py

[Lint]Style: Convert vllm-ascend/ to ruff format(Batch #2) (#5977)

2026-01-19 08:59:46 +08:00

attention_v1.py

[v0.18.0]feat(quant): add C8 INT8 KV cache support for GQA attention models (#7474) (#8007)

2026-04-08 10:51:58 +08:00

mla_v1.py

[0.18.0][BugFix] Add PrefillNoCache state in mla _forward_decode for short prompt (#8264)

2026-04-15 09:23:52 +08:00

sfa_v1.py

[v0.18.0][BugFix] Fix bug of precision when DSA-CP is enabled on GLM5 (#7843)

2026-03-31 21:51:10 +08:00

utils.py

feat(attention_cp): support chunked prefill for Qwen3Next with PCP&DCP (#6900)

2026-03-09 17:55:09 +08:00