i-shenzhaofeng/enginex-hygon-vllm
1
0
Fork 0
forked from EngineX-Hygon/enginex-hygon-vllm
Code Pull Requests Activity

update vllm

Browse Source
This commit is contained in:
zhousha
2025-11-24 16:12:09 +08:00
parent cd5b3fdf61
commit 0fc6debf79
10 changed files with 89 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
enginex/Qwen1.5-14B-Chat.md Normal file
View File

@@ -0,0 +1,9 @@
# 运行方式
```python
# 推荐使用docker方式运行，提供拉取的docker镜像：
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
docker run -it --shm-size=1024G -v $PWD/qwen1.5-pytorch:/home/Qwen1.5-pytorch -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name Qwen1.5-pytorch bash # 为以上拉取的docker的镜像ID替换，本镜像为：ffa1f63239fc
cd /home/Qwen1.5-pytorch
pip install -r requirement.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
```