EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Improve Chinese character streaming when the last char is half Chinese word. (#95)

Browse Source
This commit is contained in:
Haotian Liu
2024-01-24 14:23:27 -06:00
committed by GitHub
parent 01ee0fbc05
commit d3fc86a43e
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
python/sglang/utils.py
View File

@@ -154,6 +154,9 @@ def find_printable_text(text):
# If the last token is a CJK character, we print the characters. # If the last token is a CJK character, we print the characters.
elif len(text) > 0 and _is_chinese_char(ord(text[-1])): elif len(text) > 0 and _is_chinese_char(ord(text[-1])):
return text return text
# Otherwise if the penultimate token is a CJK character, we print the characters except for the last one.
elif len(text) > 1 and _is_chinese_char(ord(text[-2])):
return text[:-1]
# Otherwise, prints until the last space char (simple heuristic to avoid printing incomplete words, # Otherwise, prints until the last space char (simple heuristic to avoid printing incomplete words,
# which may change with the subsequent token -- there are probably smarter ways to do this!) # which may change with the subsequent token -- there are probably smarter ways to do this!)
else: else: