EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Update README.md (#2605)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-12-26 10:58:49 -08:00
committed by GitHub
parent 2125898af5
commit f46f394f4d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
benchmark/deepseek_v3/README.md
View File

@@ -4,7 +4,7 @@ We're excited to announce [SGLang v0.4.1](https://github.com/sgl-project/sglang/
The SGLang and DeepSeek teams worked together to get DeepSeek V3 FP8 running on NVIDIA and AMD GPU **from day one**. We've also supported MLA optimization and DP attention before, making SGLang one of the best open-source LLM engines for running DeepSeek models. The SGLang and DeepSeek teams worked together to get DeepSeek V3 FP8 running on NVIDIA and AMD GPU **from day one**. We've also supported MLA optimization and DP attention before, making SGLang one of the best open-source LLM engines for running DeepSeek models.
Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model Performance Team for their support, and DataCrunch for providing GPU resources. Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model Performance Team for implementing the model, and DataCrunch for providing GPU resources.
## Hardware Recommendation ## Hardware Recommendation
- 8 x NVIDIA H200 GPUs - 8 x NVIDIA H200 GPUs