EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fix LiteLLM kwargs (#817)

Browse Source
This commit is contained in:
Enrique Shockwave
2024-07-30 06:38:02 +01:00
committed by GitHub
parent a50c8a14b3
commit 21e22b9e96
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/lang/backend/litellm.py
View File

@@ -61,7 +61,7 @@ class LiteLLM(BaseBackend):
model=self.model_name, model=self.model_name,
messages=messages, messages=messages,
**self.client_params, **self.client_params,
**sampling_params.to_anthropic_kwargs(), **sampling_params.to_litellm_kwargs(),
) )
comp = ret.choices[0].message.content comp = ret.choices[0].message.content