3 Commits

Author	SHA1	Message	Date
Qingquan Song	4068e01292	Fix per token fp8 quant precision (#4362)	2025-03-12 21:19:05 -07:00
Stefan He	e0917e6bd0	Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) ... Co-authored-by: Stefan He <bhe@linkedin.com>	2025-03-12 00:08:03 -07:00
Lianmin Zheng	8abf74e3c9	Rename files in sgl kernel to avoid nested folder structure (#4213) ... Co-authored-by: zhyncs <me@zhyncs.com>	2025-03-08 22:54:51 -08:00