EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[Misc] Limit ray version (#3660)

Browse Source 
We notice that with ray>2.48.0, the npu card count is not correct from
ray. This is a know bug. Let's limit ray version to <2.48.0 now.

- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
This commit is contained in:
wangxiyuan
2025-10-25 09:36:44 +08:00
committed by GitHub
parent 8295136575
commit 6922947033
7 changed files with 8 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
Dockerfile
View File

@@ -54,7 +54,7 @@ RUN export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
python3 -m pip cache purge python3 -m pip cache purge
# Install modelscope (for fast download) and ray (for multinode) # Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope 'ray>=2.47.1' 'protobuf>3.20.0' && \ RUN python3 -m pip install modelscope 'ray>=2.47.1,<=2.48.0' 'protobuf>3.20.0' && \
python3 -m pip cache purge python3 -m pip cache purge
CMD ["/bin/bash"] CMD ["/bin/bash"]

2
Dockerfile.310p
View File

@@ -55,7 +55,7 @@ RUN export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
python3 -m pip cache purge python3 -m pip cache purge
# Install modelscope (for fast download) and ray (for multinode) # Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope 'ray>=2.47.1' 'protobuf>3.20.0' && \ RUN python3 -m pip install modelscope 'ray>=2.47.1,<=2.48.0' 'protobuf>3.20.0' && \
python3 -m pip cache purge python3 -m pip cache purge
CMD ["/bin/bash"] CMD ["/bin/bash"]

2
Dockerfile.310p.openEuler
View File

@@ -53,7 +53,7 @@ RUN export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
python3 -m pip cache purge python3 -m pip cache purge
# Install modelscope (for fast download) and ray (for multinode) # Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope 'ray>=2.47.1' 'protobuf>3.20.0' && \ RUN python3 -m pip install modelscope 'ray>=2.47.1,<=2.48.0' 'protobuf>3.20.0' && \
python3 -m pip cache purge python3 -m pip cache purge
CMD ["/bin/bash"] CMD ["/bin/bash"]

2
Dockerfile.a3
View File

@@ -54,7 +54,7 @@ RUN export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
python3 -m pip cache purge python3 -m pip cache purge
# Install modelscope (for fast download) and ray (for multinode) # Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope 'ray>=2.47.1' 'protobuf>3.20.0' && \ RUN python3 -m pip install modelscope 'ray>=2.47.1,<=2.48.0' 'protobuf>3.20.0' && \
python3 -m pip cache purge python3 -m pip cache purge
CMD ["/bin/bash"] CMD ["/bin/bash"]

2
Dockerfile.a3.openEuler
View File

@@ -52,7 +52,7 @@ RUN export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
python3 -m pip cache purge python3 -m pip cache purge
# Install modelscope (for fast download) and ray (for multinode) # Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope 'ray>=2.47.1' 'protobuf>3.20.0' && \ RUN python3 -m pip install modelscope 'ray>=2.47.1,<=2.48.0' 'protobuf>3.20.0' && \
python3 -m pip cache purge python3 -m pip cache purge
CMD ["/bin/bash"] CMD ["/bin/bash"]

2
Dockerfile.openEuler
View File

@@ -52,7 +52,7 @@ RUN export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
python3 -m pip cache purge python3 -m pip cache purge
# Install modelscope (for fast download) and ray (for multinode) # Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope 'ray>=2.47.1' 'protobuf>3.20.0' && \ RUN python3 -m pip install modelscope 'ray>=2.47.1,<=2.48.0' 'protobuf>3.20.0' && \
python3 -m pip cache purge python3 -m pip cache purge
CMD ["/bin/bash"] CMD ["/bin/bash"]

4
requirements-dev.txt
View File

@@ -13,8 +13,8 @@ types-psutil
pytest-cov pytest-cov
regex regex
sentence_transformers sentence_transformers
ray>=2.47.1 ray>=2.47.1,<=2.48.0
protobuf>3.20.0 protobuf>3.20.0
librosa librosa
soundfile soundfile
pytest_mock pytest_mock