Adding Documentation for installation (#1300)

Co-authored-by: zhaochen20 <zhaochenyang20@gmail.com>
This commit is contained in:
Chayenne
2024-09-10 10:09:13 +08:00
committed by GitHub
parent 9144ed1067
commit 743007e1ce
3 changed files with 136 additions and 6 deletions

View File

@@ -1,4 +1,4 @@
Welcome to SGLang's tutorials!
Welcome to SGLang!
====================================
.. figure:: ./_static/image/logo.png
@@ -27,9 +27,22 @@ SGLang has the following core features:
* **Flexible Frontend Language**: Enables easy programming of LLM applications with chained generation calls, advanced prompting, control flow, multiple modalities, parallelism, and external interactions.
* **Extensive Model Support**: SGLang supports a wide range of generative models including the Llama series (up to Llama 3.1), Mistral, Gemma, Qwen, DeepSeek, LLaVA, Yi-VL, StableLM, Command-R, DBRX, Grok, ChatGLM, InternLM 2 and Exaone 3. It also supports embedding models such as e5-mistral and gte-Qwen2. Easily extensible to support new models.
* **Open Source Community**: SGLang is an open source project with a vibrant community of contributors. We welcome contributions from anyone interested in advancing the state of the art in LLM and VLM serving.
Documentation
-------------
.. In this documentation, we'll dive into these following areas to help you get the most out of SGLang.
.. _installation:
.. toctree::
:maxdepth: 1
:caption: Installation
install.md
.. _hyperparameter_tuning:
.. toctree::
:maxdepth: 1
@@ -58,7 +71,10 @@ Documentation
sampling_params.md
Search Bar
==================
* :ref:`search`
.. _benchmark_and_profilling:
.. toctree::
:maxdepth: 1
:caption: Benchmark and Profilling
benchmark_and_profiling.md