4 Commits

Author	SHA1	Message	Date
Lianmin Zheng	c51020cf0c	Fix the chat template for llava-v1.6-34b & format code (#177)	2024-02-11 05:50:13 -08:00
Lianmin Zheng	6f560c761b	Improve the control of streaming and improve the first token latency in streaming (#117)	2024-01-29 17:05:42 -08:00
Liangsheng Yin	40ab1f0129	Fix the possible bug of decode out of memory (#36)	2024-01-19 11:01:15 -08:00
Lianmin Zheng	22085081bb	release initial code ... Co-authored-by: Ying Sheng <sqy1415@gmail.com> Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com> Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu> Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com> Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com> Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>	2024-01-08 04:37:50 +00:00