i-shenzhaofeng/enginex-hygon-vllm
1
0
Fork 0
forked from EngineX-Hygon/enginex-hygon-vllm
Code Pull Requests Activity

update vllm

Browse Source
This commit is contained in:
zhousha
2025-12-01 18:40:23 +08:00
parent ce7fc3b2c4
commit b1635efc43
15 changed files with 82 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
enginex/gpt2.md Normal file
View File

@@ -0,0 +1,8 @@
# 运行方式
```python
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:1.10.0-centos7.6-dtk-23.04-py37-latest
docker run -dit --network=host --name=gpt2_pytorch --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 image.sourcefind.cn:5000/dcu/admin/base/pytorch:1.10.0-centos7.6-dtk-23.04-py37-latest
docker exec -it gpt2_pytorch /bin/bash
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
```