Zetong Li b6aa5bbdbf [0.18.0][BugFix] Add PrefillNoCache state in mla _forward_decode for short prompt (#8264) ...

### What this PR does / why we need it?
This PR is cherry-pick from #8263.

This PR aims to fix short prompt problem. The root cause can be found in
#8029. Since the previous pr may miss mixed long and short prompt batch,
after discussion, we decide to add PrefillNoCache state in mla
_forward_decode now instead.

Signed-off-by: Zetong Li <slippersss@126.com>

2026-04-15 09:23:52 +08:00

..

_310p

[BugFix][0.18.0][310p] fix post-sampling not working in graph mode on 310p (#8077)

2026-04-09 16:31:38 +08:00

_cann_ops_custom

[Kernel] add custom op GmmSwigluQuantWeightNzTensorList (#3804)

2025-11-28 18:06:39 +08:00

attention

[0.18.0][BugFix] Add PrefillNoCache state in mla _forward_decode for short prompt (#8264)

2026-04-15 09:23:52 +08:00

compilation

[Feat][SP] Suport SP for VL MoE models (#7044)

2026-03-24 17:16:00 +08:00

core

[v0.18.0][Misc] Recompute scheduler upgrade to vLLM 0.18.0 (#7720)

2026-03-27 18:24:53 +08:00

device

[A5][bugfix] Fix fused MoE A5 MXFP8 scale normalization, load-balance routing and gating_topk ops (#7573)

2026-03-25 17:20:28 +08:00

device_allocator

[Lint]Style: Convert vllm-ascend/ to ruff format(Batch #2) (#5977)

2026-01-19 08:59:46 +08:00

distributed

[BugFix][P/D][0.18.0]Add a retry mechanism to prevent packet loss (#8167)

2026-04-12 23:30:45 +08:00

eplb

[V0.18.0][EPLB][BugFix] Fix moe_load precision in allgather (#7890)

2026-04-02 09:20:31 +08:00

kv_offload

upgrade to 0.18.0 (#7502)

2026-03-21 16:05:38 +08:00

lora

[Bugfix][LoRA] Fix the bug when runs Qwen3-Reranker-0.6B with LoRA. (#7156)

2026-03-15 17:55:42 +08:00

model_loader

[ModelLoader][Feature] Add rfork support for fast model loading (#7392)

2026-03-25 16:40:30 +08:00

ops

[v0.18.0][BugFix] Fix Qwen3.5 MoE flash comm v1 shared expert shape error of mtp layer on A2 (#8004)

2026-04-13 17:36:09 +08:00

patch

[bugfix]fix extra npu context in device 0 (#8041)

2026-04-08 23:35:52 +08:00

quantization

[v0.18.0]feat(quant): add C8 INT8 KV cache support for GQA attention models (#7474) (#8007)

2026-04-08 10:51:58 +08:00

sample

[releases/v0.18.0][Triton][Sampler] Add penalty-related Triton kernel for better performance of penalties (#7794)

2026-03-31 19:01:51 +08:00

spec_decode

[v0.18.0][BugFix] Fix Qwen3.5 MoE flash comm v1 shared expert shape error of mtp layer on A2 (#8004)

2026-04-13 17:36:09 +08:00

worker

[0.18.0][BugFix] Add PrefillNoCache state in mla _forward_decode for short prompt (#8264)

2026-04-15 09:23:52 +08:00

xlite

Main2main upgrade to vllm 0317 afternoon (#7409)

2026-03-18 23:24:27 +08:00

__init__.py

[ModelLoader][Feature] Add rfork support for fast model loading (#7392)

2026-03-25 16:40:30 +08:00

ascend_config.py

[feat] support dispatch_v2/combine_v2 hierarchy communication (#7698)

2026-03-27 09:20:16 +08:00

ascend_forward_context.py

[Bugfix][eager][oom] fix rank0 load imbalance by no padding when multi dp (#7297)

2026-03-23 17:05:02 +08:00

batch_invariant.py

[CI] Add pre-commit check for patch logger (#7446)

2026-03-19 16:53:20 +08:00

cpu_binding.py

[CPU binding] Implement global CPU slicing and improve IRQ binding for Ascend NPUs (#6945)

2026-03-03 17:20:52 +08:00

envs.py

[Misc] Drop Prefetch MLP Env (#7357)

2026-03-19 14:27:27 +08:00

flash_common3_context.py

[Lint]Style: Convert vllm-ascend/compilation to ruff format (#5912)

2026-01-16 20:57:46 +08:00

meta_registration.py

[Ops][Refactor] Remove custom rotary_embedding operator (#6523)

2026-02-07 09:24:05 +08:00

platform.py

[BugFix] Add async communication check for capturing mode (#8149)

2026-04-12 21:52:54 +08:00

profiling_config.py

[Core][Misc] Clean up ProfileExecuteDuration (#6461)

2026-02-01 20:06:01 +08:00

utils.py

[cherry-pick][BugFix] Improve max_cudagraph_capture_size validation (#8252)

2026-04-14 22:00:10 +08:00