EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

fix a bug in v1_embeeding_request (#2014)

Browse Source
This commit is contained in:
Xiaoyu Zhang
2024-11-12 16:49:45 +08:00
committed by GitHub
parent 78c1d6445f
commit a1bd719031
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/openai_api/adapter.py
View File

@@ -1281,7 +1281,7 @@ def v1_embedding_request(all_requests, tokenizer_manager):
else: else:
prompt_kwargs = {"input_ids": prompt} prompt_kwargs = {"input_ids": prompt}
else: else:
if isinstance(prompts[0], str) or isinstance(propmt[0][0], str): if isinstance(prompts[0], str) or isinstance(propmts[0][0], str):
prompt_kwargs = {"text": prompts} prompt_kwargs = {"text": prompts}
else: else:
prompt_kwargs = {"input_ids": prompts} prompt_kwargs = {"input_ids": prompts}