4 Commits

Author	SHA1	Message	Date
Lianmin Zheng	722530fa01	Enable overlap scheduler by default for the triton attention backend (#2105)	2024-11-20 02:58:35 -08:00
Lianmin Zheng	a2e0424abf	Fix memory leak for chunked prefill 2 (#1858) ... Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>	2024-10-31 14:51:51 -07:00
Lianmin Zheng	b548801ddb	Update docs (#1839)	2024-10-30 02:49:08 -07:00
Lianmin Zheng	6aa94b967c	Update ci workflows (#1804)	2024-10-26 04:32:36 -07:00