From 2c3656f2762621c927505cf9be9b7f1d8e1601fb Mon Sep 17 00:00:00 2001 From: shizhediao Date: Wed, 12 Mar 2025 15:53:26 -0700 Subject: [PATCH] [Fix Doc.] Enable internal forwarding when starting the router (#4355) --- docs/router/router.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/router/router.md b/docs/router/router.md index c3ce9a316..26fa94241 100644 --- a/docs/router/router.md +++ b/docs/router/router.md @@ -27,7 +27,7 @@ The router supports two working modes: This will be a drop-in replacement for the existing `--dp-size` argument of SGLang Runtime. Under the hood, it uses multi-processes to launch multiple workers, wait for them to be ready, then connect the router to all workers. ```bash -python -m sglang_router.launch_server --model-path meta-llama/Meta-Llama-3.1-8B-Instruct --dp-size 4 +python -m sglang_router.launch_server --model-path meta-llama/Meta-Llama-3.1-8B-Instruct --dp-size 4 --host 0.0.0.0 ``` After the server is ready, you can directly send requests to the router as the same way as sending requests to each single worker.