EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[MISC] Add patch module (#526)

Browse Source 
This PR added patch module for vllm
1. platform patch: the patch will be registered when load the platform
2. worker patch: the patch will be registered when worker is started.

The detail is:
1. patch_common: patch for main and 0.8.4 version
4. patch_main: patch for main verison
5. patch_0_8_4: patch for 0.8.4 version
This commit is contained in:
wangxiyuan
2025-04-16 09:28:58 +08:00
committed by GitHub
parent 434749d299
commit bbe7ccd366
16 changed files with 185 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
vllm_ascend/__init__.py
View File

@@ -18,6 +18,10 @@
def register():
"""Register the NPU platform."""
# Adapt the global patch here.
from vllm_ascend.utils import adapt_patch
adapt_patch(is_global_patch=True)
return "vllm_ascend.platform.NPUPlatform"