EngineX-Hygon/enginex-hygon-vllm
5
0
Fork 1
Code Issues Pull Requests Actions Projects Releases Wiki Activity

update vllm

Browse Source
This commit is contained in:
zhousha
2025-11-28 10:53:56 +08:00
parent 2af60ecfd1
commit 3d2815ed62
10 changed files with 81 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
enginex/chatglm2-6b.md Normal file
View File

@@ -0,0 +1,8 @@
# 运行方式
```python
docker pull git.modelhub.org.cn:9443/enginex-hygon/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
docker exec -it chatglm /bin/bash
pip install transformers==4.28.0 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
pip install accelerate sentencepiece mdtex2html gradio rouge_chinese nltk jieba datasets==2.20.0 protobuf peft==0.5.0 pydantic==1.10.9 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
```