4 Commits

Author	SHA1	Message	Date
Lianmin Zheng	2e6e62e156	Increase the number of thread limitation for tp worker managers. (#567)	2024-06-26 09:33:45 -07:00
Lianmin Zheng	eb1ae6ae0c	Add sglang.bench_latency for offline benchmark (#564)	2024-06-25 03:38:04 -07:00
Lianmin Zheng	6e09cf6a15	Misc fixes (#432)	2024-05-12 15:05:40 -07:00
Lianmin Zheng	22085081bb	release initial code ... Co-authored-by: Ying Sheng <sqy1415@gmail.com> Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com> Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu> Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com> Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com> Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>	2024-01-08 04:37:50 +00:00