12 lines
628 B
Markdown
12 lines
628 B
Markdown
# 运行方式
|
||
|
||
```python
|
||
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.3.0-py3.10-dtk24.04.3-ubuntu20.04
|
||
# 为以上拉取的docker的镜像ID替换，本镜像为：b272aae8ec72
|
||
docker run -it --shm-size=64G -v $PWD/Marco-o1:/home/Marco-o1 -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name marcoo1 bash
|
||
cd /home/Marco-o1
|
||
pip install -r requirements.txt
|
||
pip install whl/lmslim-0.1.2+das.dtk24043-cp310-cp310-linux_x86_64.whl # 安装lmslim==0.1.2
|
||
pip install whl/vllm-0.6.2+das.opt1.cd549d3.dtk24043-cp310-cp310-linux_x86_64.whl # 安装vllm==0.6.2
|
||
```
|