forked from EngineX-Hygon/enginex-hygon-vllm
14 lines
667 B
Markdown
14 lines
667 B
Markdown
# 运行方式
|
||
|
||
```python
|
||
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.4.1-ubuntu22.04-dtk25.04-py3.10-fixpy
|
||
# 为以上拉取的docker的镜像ID替换，本镜像为：e77c15729879
|
||
docker run -it --shm-size=64G -v $PWD/Qwen2.5-Omni:/home/Qwen2.5-Omni -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name qomni bash
|
||
cd /home/Qwen2.5-Omni
|
||
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple
|
||
|
||
unzip f742a644ca32e65758c3adb36225aef1731bd2a8.zip
|
||
cd transformers-f742a644ca32e65758c3adb36225aef1731bd2a8
|
||
pip install -e . # 作者限定只能使用transformers==4.50.0.dev0
|
||
```
|