EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[CI] change to quay.io (#102)

Browse Source 
change docker registry to quay

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
This commit is contained in:
wangxiyuan
2025-02-19 17:04:46 +08:00
committed by GitHub
parent fafd70e91c
commit cff03a4913
8 changed files with 26 additions and 29 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/tutorials.md
View File

@@ -20,7 +20,7 @@ docker run \
-v /etc/ascend_install.info:/etc/ascend_install.info \
-v /root/.cache:/root/.cache \
-p 8000:8000 \
-it ghcr.io/vllm-project/vllm-ascend:v0.7.1.rc1 bash
-it quay.io/ascend/vllm-ascend:v0.7.1rc1 bash
```
Setup environment variables:
@@ -83,7 +83,7 @@ docker run \
-p 8000:8000 \
-e VLLM_USE_MODELSCOPE=True \
-e PYTORCH_NPU_ALLOC_CONF=max_split_size_mb:256 \
-it ghcr.io/vllm-project/vllm-ascend:v0.7.1.rc1 \
-it quay.io/ascend/vllm-ascend:v0.7.1rc1 \
vllm serve Qwen/Qwen2.5-7B-Instruct --max_model_len 26240
```
@@ -146,7 +146,7 @@ docker run \
-v /etc/ascend_install.info:/etc/ascend_install.info \
-v /root/.cache:/root/.cache \
-p 8000:8000 \
-it ghcr.io/vllm-project/vllm-ascend:v0.7.1.rc1 bash
-it quay.io/ascend/vllm-ascend:v0.7.1rc1 bash
```
Setup environment variables: