EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Recover vllm-ascend dev image (#209)

Browse Source 
### What this PR does / why we need it?
Recover vllm-ascend dev image

### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed

Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
This commit is contained in:
Yikun Jiang
2025-03-03 09:08:41 +08:00
committed by GitHub
parent 6e358c4bef
commit ebe14f20cf
7 changed files with 53 additions and 35 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
Dockerfile
View File

@@ -23,7 +23,7 @@ ARG PIP_INDEX_URL="https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple"
ENV DEBIAN_FRONTEND=noninteractive
RUN apt-get update -y && \
apt-get install -y python3-pip git vim && \
apt-get install -y python3-pip git vim net-tools && \
rm -rf /var/cache/apt/* && \
rm -rf /var/lib/apt/lists/*
@@ -33,15 +33,19 @@ COPY . /workspace/vllm-ascend/
RUN pip config set global.index-url ${PIP_INDEX_URL}
# Install vLLM main
# Install vLLM
ARG VLLM_REPO=https://github.com/vllm-project/vllm.git
RUN git clone --depth 1 $VLLM_REPO /workspace/vllm
ARG VLLM_TAG=main
RUN git clone --depth 1 $VLLM_REPO --branch $VLLM_TAG /workspace/vllm
RUN VLLM_TARGET_DEVICE="empty" python3 -m pip install /workspace/vllm/
# Install vllm-ascend main
# Install vllm-ascend
RUN python3 -m pip install /workspace/vllm-ascend/ --extra-index https://download.pytorch.org/whl/cpu/
# Install modelscope (for fast download) and ray/net-tools (for multinode)
RUN python3 -m pip install modelscope ray net-tools
# Install torch-npu
RUN bash /workspace/vllm-ascend/pta_install.sh
# Install modelscope (for fast download) and ray (for multinode)
RUN python3 -m pip install modelscope ray
CMD ["/bin/bash"]