From 637de9e8ce91fd3e92755eb2a842860925954ab1 Mon Sep 17 00:00:00 2001 From: fsygd Date: Thu, 26 Dec 2024 21:31:56 +0800 Subject: [PATCH] update readme of DeepSeek V3 (#2596) --- benchmark/deepseek_v3/README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/benchmark/deepseek_v3/README.md b/benchmark/deepseek_v3/README.md index 47ba1e9fc..73b3612da 100644 --- a/benchmark/deepseek_v3/README.md +++ b/benchmark/deepseek_v3/README.md @@ -26,6 +26,8 @@ pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/ python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-Base --enable-dp-attention --tp 8 --trust-remote-code ``` +If you see errors when launching the server, please check if it has finished downloading the weights. It is recommended to download the weights before launching, or to launch multiple times until all the weights have been downloaded. + ### Example with OpenAI API ```python3