lidenghui1110 0f3939e5a9 [Feature]cpu offload connector (#1659) ...

This PR implements cpu offload connector to enable NPU kv cache offload
to host DRAM.

- vLLM version: v0.10.2
- vLLM main:
5aeb925452

Signed-off-by: lidenghui <lidenghui1110@gmail.com>
Signed-off-by: AlvisGong <gwly0401@163.com>
Signed-off-by: CalvinXKY <kyxiezju@163.com>
Co-authored-by: AlvisGong <gwly0401@163.com>

2025-09-23 14:25:05 +08:00

..

__init__.py

[Feature]cpu offload connector (#1659)

2025-09-23 14:25:05 +08:00

cpu_kv_cache_manager.py

[Feature]cpu offload connector (#1659)

2025-09-23 14:25:05 +08:00

metadata.py

[Feature]cpu offload connector (#1659)

2025-09-23 14:25:05 +08:00