EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Simplify documentation in README.md (#1851)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-10-30 21:57:49 -07:00
committed by GitHub
parent 438526a814
commit 0ab7bcaf66
4 changed files with 22 additions and 577 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/frontend.md
View File

@@ -1,8 +1,8 @@
## Frontend: Structured Generation Language (SGLang)
# Frontend: Structured Generation Language (SGLang)
The frontend language can be used with local models or API models. It is an alternative to the OpenAI API. You may found it easier to use for complex prompting workflow.
### Quick Start
The example below shows how to use sglang to answer a mulit-turn question.
The example below shows how to use SGLang to answer a multi-turn question.
#### Using Local Models
First, launch a server with