EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

misc: replace deprecated variable HUGGING_FACE_HUB_TOKEN with HF_TOKEN (#752)

Browse Source
This commit is contained in:
Yineng Zhang
2024-07-27 04:19:30 +10:00
committed by GitHub
parent 8628ab9c8b
commit 3e455b016e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -65,7 +65,7 @@ Repalce `<secret>` below with your huggingface hub [token](https://huggingface.c
docker run --gpus all \ docker run --gpus all \
-p 30000:30000 \ -p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \ -v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HUGGING_FACE_HUB_TOKEN=<secret>" \ --env "HF_TOKEN=<secret>" \
--ipc=host \ --ipc=host \
lmsysorg/sglang:latest \ lmsysorg/sglang:latest \
python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --host 0.0.0.0 --port 30000 python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --host 0.0.0.0 --port 30000