EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Improve docs and fix the broken links (#1875)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-11-01 17:47:44 -07:00
committed by GitHub
parent d59a47828c
commit d1b31b0684
9 changed files with 607 additions and 876 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/references/custom_chat_template.md
View File

@@ -1,3 +1,5 @@
.. _custom-chat-template:
# Custom Chat Template in SGLang Runtime
**NOTE**: There are two chat template systems in SGLang project. This document is about setting a custom chat template for the OpenAI-compatible API server (defined at [conversation.py](https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/conversation.py)). It is NOT related to the chat template used in the SGLang language frontend (defined at [chat_template.py](https://github.com/sgl-project/sglang/blob/main/python/sglang/lang/chat_template.py)).

2
docs/references/sampling_params.md
View File

@@ -1,3 +1,5 @@
.. _sampling-parameters:
# Sampling Parameters in SGLang Runtime
This doc describes the sampling parameters of the SGLang Runtime.
It is the low-level endpoint of the runtime.