EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Update setup_github_runner.md (#1952)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-11-07 19:20:47 -08:00
committed by GitHub
parent 691808d587
commit a71a44f203
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/developer/setup_github_runner.md
View File

@@ -1,4 +1,4 @@
# Set Up Self-hosted Runners for GitHub Action
# Set Up Self-Hosted Runners for GitHub Action
## Add a Runner
@@ -9,9 +9,9 @@ You can mount a folder for the shared huggingface model weights cache. The comma
```
docker pull nvidia/cuda:12.1.1-devel-ubuntu22.04
# Nvidia
docker run --shm-size 64g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash
docker run --shm-size 128g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash
# AMD
docker run --rm --device=/dev/kfd --device=/dev/dri --group-add video --shm-size 64g -it -v /tmp/huggingface:/hf_home henryx/haisgl:sgl0.3.1.post3_vllm0.6.0_triton3.0.0_rocm6.2.1 /bin/bash
docker run --rm --device=/dev/kfd --device=/dev/dri --group-add video --shm-size 128g -it -v /tmp/huggingface:/hf_home henryx/haisgl:sgl0.3.1.post3_vllm0.6.0_triton3.0.0_rocm6.2.1 /bin/bash
```
### Step 2: Configure the runner by `config.sh`