hucong 7ea17fbee3 [0.11.0][BugFix] Improve the performance of prefixcache features (#4021) ...

### What this PR does / why we need it?
cherry-pick from https://github.com/vllm-project/vllm-ascend/pull/4022

The code bug caused an empty bubble. When the npu_paged_cache_load
operator was called, it forcibly transferred seq_len2 to the device,
which triggered synchronization and interrupted the CPU operator's
launch stream.


---------

Signed-off-by: underfituu <hzhucong@163.com>

2025-11-10 11:51:34 +08:00

..

e2e

[v0.11.0][Bugfix] fix sleepmode level2 e2e test (#4023)

2025-11-08 14:11:15 +08:00

ut

[0.11.0][BugFix] Improve the performance of prefixcache features (#4021)

2025-11-10 11:51:34 +08:00

__init__.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00