4 Commits

Author	SHA1	Message	Date
Wenbo Yang	75b656488a	Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418)	2025-03-17 00:03:43 -07:00
Ke Bao	0ac019f171	Support sm90 Int8 gemm (#3035)	2025-01-21 22:21:54 +08:00
Ke Bao	58f9060efe	Update int8 gemm config (#2774)	2025-01-07 19:47:37 +08:00
Ke Bao	0f3eb1d294	Support cutlass Int8 gemm (#2752)	2025-01-06 22:51:22 +08:00