From 92bb64bc8600bfb4c2a8d9db30ded7b1e7f5ab43 Mon Sep 17 00:00:00 2001 From: Michael Yao Date: Tue, 22 Apr 2025 11:39:37 +0800 Subject: [PATCH] [Doc] Fix a 404 link to llama-405b (#5615) Signed-off-by: windsonsea --- docs/backend/server_arguments.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/backend/server_arguments.md b/docs/backend/server_arguments.md index 560b4deb2..1aa64695c 100644 --- a/docs/backend/server_arguments.md +++ b/docs/backend/server_arguments.md @@ -127,7 +127,7 @@ Please consult the documentation below to learn more about the parameters you ma ## Multi-node distributed serving * `dist_init_addr`: The TCP address used for initializing PyTorch's distributed backend (e.g. `192.168.0.2:25000`). -* `nnodes`: Total number of nodes in the cluster. Refer to how to run the [Llama 405B model](https://docs.sglang.ai/references/llama_405B.html#run-405b-fp16-on-two-nodes). +* `nnodes`: Total number of nodes in the cluster. Refer to how to run the [Llama 405B model](https://docs.sglang.ai/references/multi_node.html#llama-3-1-405b). * `node_rank`: Rank (ID) of this node among the `nnodes` in the distributed setup.