From fbf42263f1ba0c6775b92062661a5d2c1fb3bd68 Mon Sep 17 00:00:00 2001 From: Lianmin Zheng Date: Tue, 16 Jan 2024 02:46:27 -0800 Subject: [PATCH] Update Readme (#11) --- README.md | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 98514d9fd..2c7306a8c 100644 --- a/README.md +++ b/README.md @@ -36,6 +36,12 @@ pip install -e "python[all]" The example below shows how to use sglang to answer a mulit-turn question. ### Using OpenAI Models +Set the OpenAI API Key +``` +export OPENAI_API_KEY=sk-xxxxxx +``` + +Then, answer a multi-turn question. ```python from sglang import function, system, user, assistant, gen, set_default_backend, OpenAI @@ -99,7 +105,7 @@ To begin with, import sglang. import sglang as sgl ``` -`sglang` provides some simple primitives such as `gen`, `select`, `fork`. +`sglang` provides some simple primitives such as `gen`, `select`, `fork`, `image`. You can implement your prompt flow in a function decorated by `sgl.function`. You can then invoke the function with `run` or `run_batch`. The system will manage the state, chat template, and parallelism for you.