EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fix after QWen support (#82)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-01-22 21:17:05 -08:00
committed by GitHub
parent 63e97e5e4c
commit 94e05770db
4 changed files with 46 additions and 43 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
python/sglang/lang/chat_template.py
View File

@@ -168,7 +168,10 @@ def match_llama2_chat(model_path: str):
@register_chat_template_matching_function
def match_chat_ml(model_path: str):
if "tinyllama" in model_path.lower():
model_path = model_path.lower()
if "tinyllama" in model_path:
return get_chat_template("chatml")
if "qwen" in model_path and "chat" in model_path:
return get_chat_template("chatml")