Stefan He 63ee26d162 Add sgl_per_token_quant_fp8 (#4089)

2025-03-06 20:53:05 -08:00

..

test_activation.py

sync flashinfer and update sgl-kernel tests (#3081)

2025-01-23 21:13:55 +08:00

test_bmm_fp8.py

feat: integrate bmm_fp8 kernel into sgl-kernel (#3056)

2025-01-23 00:39:38 +08:00

test_cublas_grouped_gemm.py

[Feature] Apply Cublas Grouped Gemm kernel (#3629)

2025-02-18 15:18:31 +08:00

test_fp8_blockwise_gemm.py

support blockwise fp8 matmul kernel (#3267)

2025-02-13 01:49:33 +08:00

test_fp8_gemm.py

support w8a8 fp8 kernel with CUTLASS (#3047)

2025-01-26 15:46:51 +08:00

test_int8_gemm.py

Support sm90 Int8 gemm (#3035)

2025-01-21 22:21:54 +08:00

test_lightning_attention_decode.py

sync flashinfer and update sgl-kernel tests (#3081)

2025-01-23 21:13:55 +08:00

test_moe_align.py

Revert "[MOE] enable efficient moe_alignment multi-blocks execution (3x~6x)" (#3982)

2025-02-28 23:57:17 -08:00

test_norm.py

cleanup sgl-kernel kernels (#3175)

2025-01-27 19:11:01 +08:00

test_per_tensor_quant_fp8.py

[quant kernel] sgl-kernel support per_tensor_quant fp8 (#3786)

2025-03-06 18:05:43 -08:00

test_per_token_group_quant_fp8.py

optimize per token group quant fp8 (#3490)

2025-02-11 22:19:05 +08:00

test_per_token_quant_fp8.py

Add sgl_per_token_quant_fp8 (#4089)

2025-03-06 20:53:05 -08:00

test_rotary_embedding.py

[kernel] Fix position ids in rope (#3173)

2025-01-27 17:09:51 +08:00

test_sampling.py

feat: integrate sampling kernels into sgl-kernel (#3086)

2025-01-24 01:54:47 +08:00

test_speculative_sampling.py

support speculative decoding kernel in sgl-kernel (#3373)

2025-02-07 20:29:51 +08:00

test_trt_allreduce.py

Reorganize python source files in sgl-kernel with multiple files (#4027)

2025-03-03 06:36:40 -08:00