Add openEuler based container image for vLLM Ascend (#489)

### What this PR does / why we need it?

Provide users with openEuler-based vllm images, so modify the quick
start readme

### Does this PR introduce _any_ user-facing change?

None

### How was this patch tested?

There is no need for performing any test.

---------

Signed-off-by: Icey <1790571317@qq.com>
This commit is contained in:
Icey
2025-04-10 14:30:49 +08:00
committed by GitHub
parent afdbf77483
commit d05ea17427
3 changed files with 178 additions and 0 deletions

View File

@@ -8,6 +8,9 @@
## Setup environment using container
:::::{tab-set}
::::{tab-item} Ubuntu OS
```{code-block} bash
:substitutions:
@@ -30,6 +33,34 @@ docker run --rm \
-p 8000:8000 \
-it $IMAGE bash
```
::::
::::{tab-item} openEuler OS
```{code-block} bash
:substitutions:
# Update DEVICE according to your device (/dev/davinci[0-7])
export DEVICE=/dev/davinci0
# Update the vllm-ascend image
export IMAGE=quay.io/ascend/vllm-ascend:|vllm_ascend_version|-openeuler
docker run --rm \
--name vllm-ascend \
--device $DEVICE \
--device /dev/davinci_manager \
--device /dev/devmm_svm \
--device /dev/hisi_hdc \
-v /usr/local/dcmi:/usr/local/dcmi \
-v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \
-v /usr/local/Ascend/driver/lib64/:/usr/local/Ascend/driver/lib64/ \
-v /usr/local/Ascend/driver/version.info:/usr/local/Ascend/driver/version.info \
-v /etc/ascend_install.info:/etc/ascend_install.info \
-v /root/.cache:/root/.cache \
-p 8000:8000 \
-it $IMAGE bash
```
::::
:::::
## Usage