4 Commits

Author	SHA1	Message	Date
Cody Yu	a7334aeea1	Support decode token logprobs (#130)	2024-02-06 12:24:55 -08:00
Lianmin Zheng	6f560c761b	Improve the control of streaming and improve the first token latency in streaming (#117)	2024-01-29 17:05:42 -08:00
Lianmin Zheng	9a16fea012	Return logprob for choices (#87)	2024-01-23 05:07:30 -08:00
Lianmin Zheng	22085081bb	release initial code ... Co-authored-by: Ying Sheng <sqy1415@gmail.com> Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com> Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu> Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com> Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com> Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>	2024-01-08 04:37:50 +00:00