EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[P/D] [bugfix] add get_kv_connector_handshake_metadata func for 0.11.2 (#4567)

Browse Source 
### What this PR does / why we need it?
add get_kv_connector_handshake_metadata func for 0.11.2


Signed-off-by: liziyu <liziyu16@huawei.com>
This commit is contained in:
liziyu
2025-11-29 16:09:45 +08:00
committed by GitHub
parent 0151022ab8
commit 53a52d6614
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
vllm_ascend/worker/worker_v1.py
View File

@@ -369,6 +369,9 @@ class NPUWorker(WorkerBase):
def get_model(self) -> nn.Module: def get_model(self) -> nn.Module:
return self.model_runner.get_model() return self.model_runner.get_model()
def get_kv_connector_handshake_metadata(self) -> Optional[dict]:
return None
def get_kv_cache_spec(self) -> dict[str, KVCacheSpec]: def get_kv_cache_spec(self) -> dict[str, KVCacheSpec]:
return self.model_runner.get_kv_cache_spec() return self.model_runner.get_kv_cache_spec()