EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

stop_str of qwen2-vl template should be a tuple not a str (#1834)

Browse Source 
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
This commit is contained in:
yizhang2077
2024-10-30 04:30:41 +08:00
committed by GitHub
parent 5010e0d2ca
commit d04899d7ca
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/lang/chat_template.py
View File

@@ -144,7 +144,7 @@ register_chat_template(
"assistant": ("<|im_start|>assistant\n", "<|im_end|>\n"), "assistant": ("<|im_start|>assistant\n", "<|im_end|>\n"),
}, },
style=ChatTemplateStyle.PLAIN, style=ChatTemplateStyle.PLAIN,
stop_str=("<|im_end|>"), stop_str=("<|im_end|>",),
image_token="<|vision_start|><|image_pad|><|vision_end|>", image_token="<|vision_start|><|image_pad|><|vision_end|>",
) )
) )