Yuan Luo 0c8dab9e67 [sgl-kernel] Opt per_token_quant_fp8 with warp reduce (#8130) ...

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

2025-07-23 21:22:59 +08:00

..

awq_kernel.cu

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842)

2025-06-17 13:45:10 -07:00

bmm_fp8.cu

Move rope and bmm into sgl-kernel (#4241)

2025-03-09 18:38:15 -07:00

dsv3_fused_a_gemm.cu

Add dsv3 fused a gemm to sgl-kernel (#7630)

2025-06-29 02:52:24 -07:00

dsv3_router_gemm_bf16_out.cu

Add bf16 output option for dsv3_router_gemm kernel (#7999)

2025-07-20 09:49:37 +08:00

dsv3_router_gemm_entry.cu

Add bf16 output option for dsv3_router_gemm kernel (#7999)

2025-07-20 09:49:37 +08:00

dsv3_router_gemm_float_out.cu

Add bf16 output option for dsv3_router_gemm kernel (#7999)

2025-07-20 09:49:37 +08:00

fp8_blockwise_gemm_kernel.cu

Upgrade CUTLASS 4.0 (#6336)

2025-05-15 17:42:23 -07:00

fp8_gemm_kernel.cu

Support fp8 gemm for blackwell (#4558)

2025-03-20 12:40:28 -07:00

int8_gemm_kernel.cu

Fix shared memory OOM on sm86 GPUs. (#4797)

2025-03-26 10:41:53 -07:00

nvfp4_expert_quant.cu

[1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093)

2025-06-02 13:48:03 -07:00

nvfp4_quant_entry.cu

[1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093)

2025-06-02 13:48:03 -07:00

nvfp4_quant_kernels.cu

fix sgl-kernel cu118 build (#4872)

2025-03-28 17:23:51 -07:00

nvfp4_scaled_mm_entry.cu

Support FP4 gemm (1/2) (#3899)

2025-03-24 19:50:23 -07:00

nvfp4_scaled_mm_kernels.cu

[Fix][Ready]Fix register spilling in cutlass nvfp4 gemm kernel on Blackwell (#8127)

2025-07-17 20:49:36 -07:00

per_tensor_quant_fp8.cu

Speed up per token and per tensor quant by 15% (#4639)

2025-03-22 00:37:57 -07:00

per_token_group_quant_8bit.cu

Fix bug of deepseek-v3 under DP+EP mode with large batchsize/seqlen (#6449)

2025-07-10 01:19:56 -07:00

per_token_quant_fp8.cu

[sgl-kernel] Opt per_token_quant_fp8 with warp reduce (#8130)

2025-07-23 21:22:59 +08:00

qserve_w4a8_per_chn_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00

qserve_w4a8_per_group_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00