EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[dist] fix communicator patch (#58)

Browse Source 
### What this PR does / why we need it?
fix communicator patch so parallel could work.
see #52

Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
Mengqing Cao
2025-02-14 10:45:49 +08:00
committed by GitHub
parent e264987af2
commit b88443b6c6
4 changed files with 7 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
vllm_ascend/platform.py
View File

@@ -88,9 +88,8 @@ class NPUPlatform(Platform):
@classmethod
def check_and_update_config(cls, vllm_config: VllmConfig) -> None:
# Register ops and patch when setup.
# Register ops when setup.
from vllm_ascend import ops # noqa: F401
from vllm_ascend import patch # noqa: F401
parallel_config = vllm_config.parallel_config
if parallel_config.worker_cls == "auto":