EngineX-Cambricon/enginex-mlu370-vllm
10
0
Fork 1
Code Issues Pull Requests Actions Projects Releases Wiki Activity

feature: add

Browse Source
This commit is contained in:
温韵清
2025-08-27 16:55:00 +08:00
parent fdf948f401
commit 608fa14c31
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -19,7 +19,7 @@ docker pull harbor.4pd.io/mic-llm-x/combricon_vllm_mlu_wyq:1.0.0
3. 启动docker 3. 启动docker
```bash ```bash
docker run -it --rm \ docker run -it --rm \
-p 100086:8000 \ -p 10086:8000 \
-e MLU_VISIBLE_DEVICES=6 \ -e MLU_VISIBLE_DEVICES=6 \
--name test_wyq1 \ --name test_wyq1 \
-v /mnt/contest_ceph/wenyunqing/models/Qwen1.5-1.8B-Chat:/model:rw \ -v /mnt/contest_ceph/wenyunqing/models/Qwen1.5-1.8B-Chat:/model:rw \
@@ -28,10 +28,10 @@ docker run -it --rm \
--device=/dev/cambricon_ipcm6:/dev/cambricon_ipcm6 \ --device=/dev/cambricon_ipcm6:/dev/cambricon_ipcm6 \
--privileged harbor.4pd.io/mic-llm-x/combricon_vllm_mlu_wyq:1.0.0 --privileged harbor.4pd.io/mic-llm-x/combricon_vllm_mlu_wyq:1.0.0
``` ```
注意需要在本地使用寒武纪 mlu370 芯片 注意需要在本地使用寒武纪 mlu370 芯片
4. 测试服务 4. 测试服务
```bash ```bash
curl http://localhost:80/v1/chat/completions \ curl http://localhost: 10086/v1/chat/completions \
-H "Content-Type: application/json" \ -H "Content-Type: application/json" \
-d '{ -d '{
"model": "llm", "model": "llm",