forked from EngineX-Hygon/enginex-hygon-vllm
update
This commit is contained in:
10
enginex/Yi-1.5-6B-Chat.md
Normal file
10
enginex/Yi-1.5-6B-Chat.md
Normal file
@@ -0,0 +1,10 @@
|
||||
# 运行方式
|
||||
|
||||
```python
|
||||
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.1.0-py3.10-dtk24.04.3-ubuntu20.04
|
||||
docker run -it --shm-size=1024G -v : -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name Yi-1.5 bash # 为以上拉取的docker的镜像ID替换
|
||||
cd /home/Yi-1.5-pytorch
|
||||
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
|
||||
|
||||
pip uninstall vllm
|
||||
```
|
||||
Reference in New Issue
Block a user