16 lines
684 B
Markdown
16 lines
684 B
Markdown
|
|
# 运行方式
|
||
|
|
|
||
|
|
```python
|
||
|
|
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
|
||
|
|
|
||
|
|
创建并启动容器:
|
||
|
|
docker run --shm-size 80g --network=host --name=telechat --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v /opt/hyhal:/opt/hyhal:ro -v : -it bash
|
||
|
|
|
||
|
|
安装依赖:
|
||
|
|
cd TeleChat
|
||
|
|
pip install -r requirements.txt -i https://pypi.mirrors.ustc.edu.cn/simple/
|
||
|
|
pip install 'ms-swift[llm]' -U -i https://pypi.mirrors.ustc.edu.cn/simple/
|
||
|
|
pip install optimum -i https://pypi.mirrors.ustc.edu.cn/simple/
|
||
|
|
pip install auto-gptq -i https://pypi.mirrors.ustc.edu.cn/simple/
|
||
|
|
```
|