Update Readme (#11)

This commit is contained in:
Lianmin Zheng
2024-01-16 02:46:27 -08:00
parent 2ccd9fd8c5
commit fbf42263f1

View File

@@ -36,6 +36,12 @@ pip install -e "python[all]"
The example below shows how to use sglang to answer a mulit-turn question.
### Using OpenAI Models
Set the OpenAI API Key
```
export OPENAI_API_KEY=sk-xxxxxx
```
Then, answer a multi-turn question.
```python
from sglang import function, system, user, assistant, gen, set_default_backend, OpenAI
@@ -99,7 +105,7 @@ To begin with, import sglang.
import sglang as sgl
```
`sglang` provides some simple primitives such as `gen`, `select`, `fork`.
`sglang` provides some simple primitives such as `gen`, `select`, `fork`, `image`.
You can implement your prompt flow in a function decorated by `sgl.function`.
You can then invoke the function with `run` or `run_batch`.
The system will manage the state, chat template, and parallelism for you.