EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

update readme of DeepSeek V3 (#2596)

Browse Source
This commit is contained in:
fsygd
2024-12-26 21:31:56 +08:00
committed by GitHub
parent acb340728c
commit 637de9e8ce
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
benchmark/deepseek_v3/README.md
View File

@@ -26,6 +26,8 @@ pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-Base --enable-dp-attention --tp 8 --trust-remote-code
```
If you see errors when launching the server, please check if it has finished downloading the weights. It is recommended to download the weights before launching, or to launch multiple times until all the weights have been downloaded.
### Example with OpenAI API
```python3