lidenghui1110 481138e1d2 [bugfix] adapt to new implemented get_kv_cache_spec in cpuoffload connector (#4311) ...

### What this PR does / why we need it?
func `get_kv_cache_spec` in model_runner changed a lot and caused error
in cpuoffloading connector which is copied from model_runner, this PR
adapts to new implemented `get_kv_cache_spec` to fix it.

### How was this patch tested?

- vLLM version: v0.11.0
- vLLM main:
2918c1b49c

Signed-off-by: lidenghui <lidenghui1110@gmail.com>

2026-01-08 09:15:09 +08:00

..

cpu_offload_manager

[bugfix] adapt to new implemented get_kv_cache_spec in cpuoffload connector (#4311)

2026-01-08 09:15:09 +08:00

device_communicators

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00

kvpool

[MM][Bugfix] Update hf_config to hf_text_config (#5319)

2026-01-06 16:41:39 +08:00

__init__.py

[Core][Worker] Add UCMConnector for KV Cache Offloading (#4411)

2025-12-16 10:53:30 +08:00

communicator.py

[2/N][Feat] Add MC2 communication method for MoE layers (#2469)

2025-08-26 19:05:23 +08:00

cpu_offload_connector.py

[bugfix] adapt to new implemented get_kv_cache_spec in cpuoffload connector (#4311)

2026-01-08 09:15:09 +08:00

mooncake_connector.py

[MM][Bugfix] Update hf_config to hf_text_config (#5319)

2026-01-06 16:41:39 +08:00

mooncake_layerwise_connector.py

[BugFix][P/D] Fix pre-create link parameter error (#5694)

2026-01-08 08:41:10 +08:00

mooncake_transfer_engine.py

[Feature][main]reconstruction kvpool connector to ascend connector (#4438)

2025-11-28 18:08:37 +08:00

parallel_state.py

[refactor] Refactor the interface for shard weight and remove the flashcomm2 o_shared interface. (#5181)

2026-01-08 09:05:02 +08:00

ucm_connector.py

[Bugfix]Add register_kv_cache in ucm_connector (#5657)

2026-01-07 11:30:33 +08:00

utils.py

[refactor] Refactor the interface for shard weight and remove the flashcomm2 o_shared interface. (#5181)

2026-01-08 09:05:02 +08:00