DefTruth 12ef7e3bc3 bugfix: fix merge_state_v2 cuda graph (#5419)

2025-04-15 10:18:47 -07:00

..

allreduce

sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079)

2025-04-05 14:23:20 -07:00

attention

bugfix: fix merge_state_v2 cuda graph (#5419)

2025-04-15 10:18:47 -07:00

cpu

Add optimized native kernels in sgl-kernel (#5150)

2025-04-08 09:37:46 -07:00

cutlass_extensions

sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207)

2025-04-09 11:47:04 -07:00

elementwise

Optimize rope in sgl kernel (#4267)

2025-03-10 10:07:45 -07:00

gemm

fix: remove cublas_grouped_gemm (#5307)

2025-04-11 16:22:37 -07:00

moe

reduce moe_align_block_size_kernel small batch mode overhead (#5086)

2025-04-09 17:59:35 -07:00

speculative

[ROCm] Enable MTP (NextN) on AMD GPU (#4631)

2025-03-23 22:58:05 -07:00

common_extension.cc

kernel: support slightly faster merge_state_v2 cuda kernel (#5381)

2025-04-14 21:28:23 -07:00

flash_extension.cc

[Fix] fix fa3 build at cu118 (#5036)

2025-04-03 11:52:35 -07:00

torch_extension_rocm.cc

update variable naming and comments for rocm (#5299)

2025-04-11 23:15:05 -07:00