Chranos/enginex-mlu370-vllm
1
0
Fork 0
forked from EngineX-Cambricon/enginex-mlu370-vllm
Code Pull Requests Activity

update Dockerfile

Browse Source
This commit is contained in:
zhousha
2025-09-19 11:20:33 +08:00
parent 608fa14c31
commit 5981370919
3 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
.DS_Store vendored Normal file
View File

Binary file not shown.

4
README.md
View File

@@ -14,7 +14,7 @@ modelscope download --model Qwen/Qwen1.5-1.8B-Chat --local_dir /mnt/contest_ceph
``` ```
2. 拉取vllm server 镜像. 2. 拉取vllm server 镜像.
``` ```
docker pull harbor.4pd.io/mic-llm-x/combricon_vllm_mlu_wyq:1.0.0 docker build -t combricon-mlu370_test_wyq:1.0.0 -f mlu370.dockerfile .
``` ```
3. 启动docker 3. 启动docker
```bash ```bash
@@ -26,7 +26,7 @@ docker run -it --rm \
--device=/dev/cambricon_dev6:/dev/cambricon_dev6 \ --device=/dev/cambricon_dev6:/dev/cambricon_dev6 \
--device=/dev/cambricon_ctl:/dev/cambricon_ctl \ --device=/dev/cambricon_ctl:/dev/cambricon_ctl \
--device=/dev/cambricon_ipcm6:/dev/cambricon_ipcm6 \ --device=/dev/cambricon_ipcm6:/dev/cambricon_ipcm6 \
--privileged harbor.4pd.io/mic-llm-x/combricon_vllm_mlu_wyq:1.0.0 --privileged combricon-mlu370_test_wyq:1.0.0
``` ```
注意需要在本地使用寒武纪 mlu370 芯片 注意需要在本地使用寒武纪 mlu370 芯片
4. 测试服务 4. 测试服务

2
docker-images/mlu370.dockerfile
View File

@@ -1,4 +1,4 @@
FROM harbor.4pd.io/mic-llm-x/combricon_vllm_mlu:v1.0_0510 FROM combricon_vllm_mlu:v1.0_0510
WORKDIR /workspace WORKDIR /workspace