update
This commit is contained in:
9
enginex/Qwen3-30B-A3B_vllm.md
Normal file
9
enginex/Qwen3-30B-A3B_vllm.md
Normal file
@@ -0,0 +1,9 @@
|
||||
# 运行方式
|
||||
|
||||
```python
|
||||
docker pull git.modelhub.org.cn:9443/enginex-hygon/vllm:0.8.5-ubuntu22.04-dtk25.04.1-rc5-das1.6-py3.10-20250724
|
||||
|
||||
docker run -it --name {docker_name} --device=/dev/kfd --privileged --network=host --device=/dev/dri --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v /public/LLM-Models:/home/LLM-Models:ro -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal:/opt/hyhal:ro --group-add video --shm-size 64G {imageID} bash
|
||||
|
||||
cd /your_code_path/qwen3-30b-a3b_vllm
|
||||
```
|
||||
Reference in New Issue
Block a user