diff --git a/docs/index.rst b/docs/index.rst index a3fbd3c10..e53ce2c76 100644 --- a/docs/index.rst +++ b/docs/index.rst @@ -58,6 +58,7 @@ The core features include: :maxdepth: 1 :caption: References + references/deepseek references/general references/hardware references/advanced_deploy diff --git a/docs/references/advanced_deploy.rst b/docs/references/advanced_deploy.rst index 24f46c4aa..b1059015d 100644 --- a/docs/references/advanced_deploy.rst +++ b/docs/references/advanced_deploy.rst @@ -3,6 +3,5 @@ Multi-Node Deployment .. toctree:: :maxdepth: 1 - deepseek.md multi_node.md k8s.md diff --git a/docs/references/deepseek.md b/docs/references/deepseek.md index ff3d649de..68bffc6e3 100644 --- a/docs/references/deepseek.md +++ b/docs/references/deepseek.md @@ -1,4 +1,4 @@ -# DeepSeek Model Usage and Optimizations +# DeepSeek Usage SGLang provides several optimizations specifically designed for the DeepSeek model to boost its inference speed. This document outlines current optimizations for DeepSeek. Additionally, the SGLang team is actively developing enhancements for [DeepSeek V3](https://github.com/sgl-project/sglang/issues/2591). diff --git a/docs/references/deepseek.rst b/docs/references/deepseek.rst new file mode 100644 index 000000000..b45383a4b --- /dev/null +++ b/docs/references/deepseek.rst @@ -0,0 +1,6 @@ +Multi-Node Deployment +========================== +.. toctree:: + :maxdepth: 1 + + deepseek.md