EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Bugfix] Fix missing abort finish reason for PD with ChatCompletion (#6693)

Browse Source 
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
This commit is contained in:
shangmingc
2025-05-28 15:39:46 +08:00
committed by GitHub
parent 461a730280
commit fba03b29e3
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/openai_api/protocol.py
View File

@@ -413,7 +413,7 @@ class ChatCompletionResponseChoice(BaseModel):
message: ChatMessage message: ChatMessage
logprobs: Optional[Union[LogProbs, ChoiceLogprobs]] = None logprobs: Optional[Union[LogProbs, ChoiceLogprobs]] = None
finish_reason: Literal[ finish_reason: Literal[
"stop", "length", "tool_calls", "content_filter", "function_call" "stop", "length", "tool_calls", "content_filter", "function_call", "abort"
] ]
matched_stop: Union[None, int, str] = None matched_stop: Union[None, int, str] = None