EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

fix bug of race condition in copy()

Browse Source
This commit is contained in:
Ying Sheng
2024-02-03 01:38:00 -08:00
parent cd8c3ccd95
commit 67be11c790
1 changed files with 2 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
python/sglang/lang/interpreter.py
View File

@@ -252,9 +252,8 @@ class StreamExecutor:
return ret return ret
def fork(self, number: int, position_ids_offset: Optional[List[int]] = None): def fork(self, number: int, position_ids_offset: Optional[List[int]] = None):
if number > 1: self.submit(SglCommitLazy())
self.submit(SglCommitLazy()) self.sync()
self.sync()
number = int(number) number = int(number)