EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Docs] Improve DPSK docs in dark mode (#3914)

Browse Source
This commit is contained in:
Stefan He
2025-02-27 00:13:04 -08:00
committed by GitHub
parent 0519269d20
commit d8a98a2cad
1 changed files with 40 additions and 68 deletions
Download Patch File Download Diff File Expand all files Collapse all files

102
docs/references/deepseek.md
View File

@@ -8,74 +8,46 @@ Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model
SGLang is recognized as one of the top engines for [DeepSeek model inference](https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3). To run DeepSeek V3/R1 models, the requirements are as follows: SGLang is recognized as one of the top engines for [DeepSeek model inference](https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3). To run DeepSeek V3/R1 models, the requirements are as follows:
<!DOCTYPE html> | Weight Type | Configuration |
<html lang="en"> |------------|-------------------|
<head> | **Full precision FP8**<br>*(recommended)* | 8 x H200 |
<meta charset="UTF-8"> | | 8 x MI300X |
<meta name="viewport" content="width=device-width, initial-scale=1.0"> | | 2 x 8 x H100/800/20 |
<title>Weight Configurations</title> | **Full precision BF16** | 2 x 8 x H200 |
<style> | | 2 x 8 x MI300X |
table { | | 4 x 8 x H100/800/20 |
| | 4 x 8 x A100/A800 |
| **Quantized weights (AWQ)** | 8 x H100/800/20 |
| | 8 x A100/A800 |
<style>
.md-typeset__table {
width: 100%; width: 100%;
}
.md-typeset__table table {
border-collapse: collapse; border-collapse: collapse;
margin: 20px 0; margin: 1em 0;
} border: 2px solid var(--md-typeset-table-color);
th, td { table-layout: fixed;
border: 1px solid #ddd; }
.md-typeset__table th {
border: 1px solid var(--md-typeset-table-color);
border-bottom: 2px solid var(--md-typeset-table-color);
background-color: var(--md-default-bg-color--lighter);
padding: 12px; padding: 12px;
text-align: left; }
}
th { .md-typeset__table td {
background-color: #f2f2f2; border: 1px solid var(--md-typeset-table-color);
} padding: 12px;
tr:nth-child(even) { }
background-color: #f9f9f9;
} .md-typeset__table tr:nth-child(2n) {
</style> background-color: var(--md-default-bg-color--lightest);
</head> }
<body> </style>
<table>
<thead>
<tr>
<th>Weight Type</th>
<th>Configuration</th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="3"><b>Full precision FP8 (recommended)</b></td>
<td>8 x H200</td>
</tr>
<tr>
<td>8 x MI300X</td>
</tr>
<tr>
<td>2 x 8 x H100/800/20</td>
</tr>
<tr>
<td rowspan="4">Full precision BF16</td>
<td>2 x 8 x H200</td>
</tr>
<tr>
<td>2 x 8 x MI300X</td>
</tr>
<tr>
<td>4 x 8 x H100/800/20</td>
</tr>
<tr>
<td>4 x 8 x A100/A800</td>
</tr>
<tr>
<td rowspan="2">Quantized weights (AWQ)</td>
<td>8 x H100/800/20</td>
</tr>
<tr>
<td>8 x A100/A800</td>
</tr>
</tbody>
</table>
</body>
</html>
Detailed commands for reference: Detailed commands for reference: