EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[PD] Fix generate endpoint of min_lb for PD (#5598)

Browse Source 
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
This commit is contained in:
shangmingc
2025-04-21 21:39:18 +08:00
committed by GitHub
parent 3f57b00a59
commit f29a718f63
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
python/sglang/srt/disaggregation/mini_lb.py
View File

@@ -187,11 +187,11 @@ async def handle_generate_request(request_data: dict):
if request_data.get("stream", False): if request_data.get("stream", False):
return await load_balancer.generate_stream( return await load_balancer.generate_stream(
modified_request, prefill_server, decode_server modified_request, prefill_server, decode_server, "generate"
) )
else: else:
return await load_balancer.generate( return await load_balancer.generate(
modified_request, prefill_server, decode_server modified_request, prefill_server, decode_server, "generate"
) )