EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[Misc] Fix import error and address nits to make CI happy (#563)

Browse Source 
1. Add `vllm_version_is` function to check vllm version.
2. `ensure_kv_transfer_initialized` and `get_kv_transfer_group ` have
been moved to other place in vllm main branch via
3408e47159
, this patch fix the import error.

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
This commit is contained in:
wangxiyuan
2025-04-18 12:23:32 +08:00
committed by GitHub
parent 66a0837963
commit 42c7fbb10e
9 changed files with 46 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
vllm_ascend/patch/platform/__init__.py
View File

@@ -14,14 +14,12 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import vllm
from packaging.version import Version
# Import common patches for all versions
from vllm_ascend.patch.platform import patch_common # noqa: F401
from vllm_ascend.utils import vllm_version_is
# Import specific patches for different versions
if Version(vllm.__version__) == Version("0.8.4"):
if vllm_version_is("0.8.4"):
from vllm_ascend.patch.platform import patch_0_8_4 # noqa: F401
from vllm_ascend.patch.platform import patch_common # noqa: F401
else:
from vllm_ascend.patch.platform import patch_common # noqa: F401
from vllm_ascend.patch.platform import patch_main # noqa: F401