5 Commits

Author	SHA1	Message	Date
Lianmin Zheng	d4fc1a70e3	Crash the server correctly during error (#2231)	2024-11-28 00:22:39 -08:00
Lianmin Zheng	86fc0d79d0	Add a watch dog thread (#1816)	2024-10-27 02:00:50 -07:00
Mingyi	158e8f1e2d	improve the threshold and ports in tests (#1215)	2024-08-25 19:02:08 -07:00
Liangsheng Yin	5d0d40d0eb	Fix CI accuracy && time out limit (#1133)	2024-08-16 21:41:11 -07:00
Liangsheng Yin	3694f8f996	Mixed style of chunked prefill (#1013)	2024-08-16 09:13:00 +00:00