EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fixed n>1 causing list index out of range with VLM (#1449)

Browse Source
This commit is contained in:
Xiao Yu
2024-09-18 03:46:32 -04:00
committed by GitHub
parent 7c162fa9c5
commit 5752f25eef
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
python/sglang/srt/managers/io_struct.py
View File

@@ -133,6 +133,9 @@ class GenerateReqInput:
self.image_data = [None] * num self.image_data = [None] * num
elif not isinstance(self.image_data, list): elif not isinstance(self.image_data, list):
self.image_data = [self.image_data] * num self.image_data = [self.image_data] * num
elif isinstance(self.image_data, list):
# multi-image with n > 1
self.image_data = self.image_data * num
if self.sampling_params is None: if self.sampling_params is None:
self.sampling_params = [{}] * num self.sampling_params = [{}] * num