EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

fix bench serving bug (#4135)

Browse Source
This commit is contained in:
Lzhang-hub
2025-03-06 21:34:02 +08:00
committed by GitHub
parent 800bf018fb
commit 3a3918121f
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/bench_serving.py
View File

@@ -220,7 +220,7 @@ async def async_request_openai_completions(
most_recent_timestamp = timestamp most_recent_timestamp = timestamp
generated_text += data["choices"][0]["text"] generated_text += data["choices"][0]["text"]
output_len = data.get("usage", {}).get( output_len = (data.get("usage") or {}).get(
"completion_tokens", output_len "completion_tokens", output_len
) )