Files
enginex-hygon-vllm/enginex/QwQ-32B.md

10 lines
469 B
Markdown
Raw Normal View History

2025-11-07 18:26:17 +08:00
# 运行方式
```python
2025-11-10 10:04:15 +08:00
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.4.1-ubuntu22.04-dtk25.04-py3.10
2025-11-07 18:26:17 +08:00
# <your IMAGE ID>为以上拉取的docker的镜像ID替换本镜像为dee41741fb40
docker run -it --shm-size=64G --network host -v $PWD/QwQ-32B:/home/QwQ-32B -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name qwq <your IMAGE ID> bash
cd /home/QwQ-32B
pip install -r requirements.txt
```