EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Use proc.join instead of busy waiting (#2374)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-12-06 02:01:23 -08:00
committed by GitHub
parent f68175967c
commit f5b2a3aa67
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
python/sglang/srt/server.py
View File

@@ -462,8 +462,8 @@ def launch_engine(
if server_args.node_rank >= 1: if server_args.node_rank >= 1:
# For other nodes, they do not need to run tokenizer or detokenizer, # For other nodes, they do not need to run tokenizer or detokenizer,
# so they can just wait here. # so they can just wait here.
while True: for proc in scheduler_procs:
pass proc.join()
else: else:
# Launch the data parallel controller # Launch the data parallel controller
reader, writer = mp.Pipe(duplex=False) reader, writer = mp.Pipe(duplex=False)