EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Improve docs & Rename Gemini -> VertexAI (#19)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-01-17 02:54:41 -08:00
committed by GitHub
parent fd7c479239
commit bf51ddc6e5
13 changed files with 56 additions and 583 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
examples/quick_start/gemini_example_complete.py
View File

@@ -1,4 +1,4 @@
from sglang import function, gen, set_default_backend, Gemini
from sglang import function, gen, set_default_backend, VertexAI
@function
@@ -16,7 +16,7 @@ A: Rome
s += "A:" + gen("answer", stop="\n", temperature=0)
set_default_backend(Gemini("gemini-pro"))
set_default_backend(VertexAI("gemini-pro"))
state = few_shot_qa.run(question="What is the capital of the United States?")
answer = state["answer"].strip().lower()