Files
sglang/docs/en/setup_runner.md

35 lines
777 B
Markdown
Raw Normal View History

2024-07-30 19:43:40 +10:00
# Set up self hosted runner for GitHub Action
## Config Runner
```bash
# https://github.com/sgl-project/sglang/settings/actions/runners/new?arch=x64&os=linux
# Involves some TOKEN and other private information, click the link to view specific steps.
```
## Start Runner
add `/lib/systemd/system/runner.service`
```
[Unit]
StartLimitIntervalSec=0
[Service]
2024-08-01 15:32:33 -07:00
Environment="CUDA_VISIBLE_DEVICES=7"
2024-08-01 17:37:47 -07:00
Environment="XDG_CACHE_HOME=/data/.cache"
2024-08-02 19:03:53 +08:00
Environment="HF_TOKEN=hf_**"
Environment="OPENAI_API_KEY=sk-**"
Environment="HOME=/data/zhyncs"
2024-07-30 19:43:40 +10:00
Restart=always
RestartSec=1
2024-08-01 15:32:33 -07:00
ExecStart=/data/zhyncs/actions-runner/run.sh
2024-07-30 19:43:40 +10:00
[Install]
WantedBy=multi-user.target
```
```bash
sudo systemctl daemon-reload
sudo systemctl start runner
sudo systemctl enable runner
sudo systemctl status runner
```