[doc] deepseekv31 support (#9544)

This commit is contained in:
Xiaotong Jiang
2025-08-23 16:54:58 -07:00
committed by GitHub
parent af9d4eb038
commit 80425e59bb
2 changed files with 82 additions and 4 deletions

View File

@@ -5,9 +5,9 @@ SGLang provides many optimizations specifically designed for the DeepSeek models
This document outlines current optimizations for DeepSeek.
For an overview of the implemented features see the completed [Roadmap](https://github.com/sgl-project/sglang/issues/2591).
## Launch DeepSeek V3 with SGLang
## Launch DeepSeek V3.1/V3/R1 with SGLang
To run DeepSeek V3/R1 models, the requirements are as follows:
To run DeepSeek V3.1/V3/R1 models, the recommended settings are as follows:
| Weight Type | Configuration |
|------------|-------------------|