EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

HotFix: json serialization error when using OAI v1/batches endpoint with logprobs (#3896)

Browse Source
This commit is contained in:
David Carreto Fidalgo
2025-03-13 06:04:29 +01:00
committed by GitHub
parent 18c27131f5
commit f7f88b706c
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/openai_api/adapter.py
View File

@@ -1147,7 +1147,7 @@ def v1_chat_generate_response(
"tool_calls": tool_calls, "tool_calls": tool_calls,
"reasoning_content": reasoning_text, "reasoning_content": reasoning_text,
}, },
"logprobs": choice_logprobs, "logprobs": choice_logprobs.model_dump() if choice_logprobs else None,
"finish_reason": (finish_reason["type"] if finish_reason else ""), "finish_reason": (finish_reason["type"] if finish_reason else ""),
"matched_stop": ( "matched_stop": (
finish_reason["matched"] finish_reason["matched"]