Rex 07f944631e Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104)

2025-03-12 00:10:02 -07:00

..

awq_kernel.cu

Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104)

2025-03-12 00:10:02 -07:00

bmm_fp8.cu

Move rope and bmm into sgl-kernel (#4241)

2025-03-09 18:38:15 -07:00

cublas_grouped_gemm.cu

Simplify tests & Fix trtllm custom allreduce registration (#4252)

2025-03-10 01:24:22 -07:00

fp8_blockwise_gemm_kernel.cu

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

fp8_gemm_kernel.cu

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

int8_gemm_kernel.cu

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

per_tensor_quant_fp8.cu

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

per_token_group_quant_fp8.cu

fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231)

2025-03-10 01:42:58 -07:00

per_token_quant_fp8.cu

Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215)

2025-03-12 00:08:03 -07:00