From 8f019c7d1aa5e9afe39f7d091871b2192bab47b9 Mon Sep 17 00:00:00 2001 From: Chayenne Date: Wed, 26 Feb 2025 11:43:20 -0800 Subject: [PATCH] Docs: Move dpsk docs forward a step (#3894) --- docs/index.rst | 1 + docs/references/advanced_deploy.rst | 1 - docs/references/deepseek.md | 2 +- docs/references/deepseek.rst | 6 ++++++ 4 files changed, 8 insertions(+), 2 deletions(-) create mode 100644 docs/references/deepseek.rst diff --git a/docs/index.rst b/docs/index.rst index a3fbd3c10..e53ce2c76 100644 --- a/docs/index.rst +++ b/docs/index.rst @@ -58,6 +58,7 @@ The core features include: :maxdepth: 1 :caption: References + references/deepseek references/general references/hardware references/advanced_deploy diff --git a/docs/references/advanced_deploy.rst b/docs/references/advanced_deploy.rst index 24f46c4aa..b1059015d 100644 --- a/docs/references/advanced_deploy.rst +++ b/docs/references/advanced_deploy.rst @@ -3,6 +3,5 @@ Multi-Node Deployment .. toctree:: :maxdepth: 1 - deepseek.md multi_node.md k8s.md diff --git a/docs/references/deepseek.md b/docs/references/deepseek.md index ff3d649de..68bffc6e3 100644 --- a/docs/references/deepseek.md +++ b/docs/references/deepseek.md @@ -1,4 +1,4 @@ -# DeepSeek Model Usage and Optimizations +# DeepSeek Usage SGLang provides several optimizations specifically designed for the DeepSeek model to boost its inference speed. This document outlines current optimizations for DeepSeek. Additionally, the SGLang team is actively developing enhancements for [DeepSeek V3](https://github.com/sgl-project/sglang/issues/2591). diff --git a/docs/references/deepseek.rst b/docs/references/deepseek.rst new file mode 100644 index 000000000..b45383a4b --- /dev/null +++ b/docs/references/deepseek.rst @@ -0,0 +1,6 @@ +Multi-Node Deployment +========================== +.. toctree:: + :maxdepth: 1 + + deepseek.md