[main][Bugfix] Remove the ZMQ communication setup on the D node (#4926)

In the PD separation scenario, the D node does not need to perform get
operations, and therefore does not need to create ZeroMQ (ZMQ)
communication.
- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c

Signed-off-by: SlightwindSec <slightwindsec@gmail.com>
This commit is contained in:
Slightwind
2025-12-12 14:37:26 +08:00
committed by GitHub
parent d54db76dd2
commit b8a317caac
2 changed files with 5 additions and 4 deletions

View File

@@ -55,7 +55,7 @@ class AscendStoreConnector(KVConnectorBase_V1):
)
assert self.connector_worker is not None
if vllm_config.parallel_config.rank == 0:
if vllm_config.parallel_config.rank == 0 and self.kv_role != "kv_consumer":
self.lookup_server = LookupKeyServer(self.connector_worker,
vllm_config,
self.use_layerwise)