4 Commits

Author	SHA1	Message	Date
Lianmin Zheng	4af3f889fc	Simplify flashinfer indices update for prefill (#2074) ... Co-authored-by: kavioyu <kavioyu@tencent.com> Co-authored-by: kavioyu <kavioyu@gmail.com>	2024-11-18 00:02:36 -08:00
Lianmin Zheng	86fc0d79d0	Add a watch dog thread (#1816)	2024-10-27 02:00:50 -07:00
Ke Bao	b8ccaf4d73	Add MLA gsm8k eval (#1484)	2024-09-21 11:16:13 +08:00
Ke Bao	a68cb201dd	Fix triton head num (#1482)	2024-09-21 10:25:20 +08:00