hucong 48094148f8 [BugFix] Improve the performance of prefixcache features (#4022) ...

### What this PR does / why we need it?
The code bug caused an empty bubble. When the npu_paged_cache_load
operator was called, it forcibly transferred seq_len2 to the device,
which triggered synchronization and interrupted the CPU operator's
launch stream.

- vLLM version: v0.11.0
- vLLM main:
83f478bb19

---------

Signed-off-by: underfituu <hzhucong@163.com>

2025-11-08 18:45:31 +08:00

..

e2e

[Bugfix] fix sleepmode level2 e2e test (#4019)

2025-11-08 14:11:55 +08:00

ut

[BugFix] Improve the performance of prefixcache features (#4022)

2025-11-08 18:45:31 +08:00

__init__.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00