EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Improve docs & Rename Gemini -> VertexAI (#19)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-01-17 02:54:41 -08:00
committed by GitHub
parent fd7c479239
commit bf51ddc6e5
13 changed files with 56 additions and 583 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
examples/quick_start/gemini_example_stream.py
View File

@@ -1,4 +1,4 @@
from sglang import function, user, assistant, gen, set_default_backend, Gemini
from sglang import function, user, assistant, gen, set_default_backend, VertexAI
@function
@@ -8,7 +8,7 @@ def multi_turn_question(s, question_1, question_2):
s += user(question_2)
s += assistant(gen("answer_2", max_tokens=256))
set_default_backend(Gemini("gemini-pro"))
set_default_backend(VertexAI("gemini-pro"))
state = multi_turn_question.run(
question_1="What is the capital of the United States?",