5 Commits

Author	SHA1	Message	Date
Lianmin Zheng	d4fc1a70e3	Crash the server correctly during error (#2231)	2024-11-28 00:22:39 -08:00
Lianmin Zheng	dfec7fca06	Rename sglang.bench_latency to sglang.bench_one_batch (#2118)	2024-11-21 20:07:48 -08:00
Lianmin Zheng	a9e90b4bce	[Minor] Fix styles for overlap mode (#2068)	2024-11-17 19:49:20 -08:00
Lianmin Zheng	c3eac1b010	Fix torch.compile for MoE (#2033)	2024-11-14 01:30:24 -08:00
Ke Bao	c77762d57f	Fix Triton decode kernel & ut (#1819)	2024-10-27 10:54:38 -07:00