Chunan Zeng 65c24c28f9 [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

..

allreduce

fix custom allreduce performance/accuracy problem (#4477)

2025-03-16 12:16:30 -07:00

attention

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

cutlass_extensions

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

elementwise

Optimize rope in sgl kernel (#4267)

2025-03-10 10:07:45 -07:00

gemm

[Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

moe

Add moe topk softmax templated from vllm (#4302)

2025-03-14 12:03:33 -07:00

speculative

[ROCm] Enable MTP (NextN) on AMD GPU (#4631)

2025-03-23 22:58:05 -07:00

torch_extension_rocm.cc

[ROCm] Enable MTP (NextN) on AMD GPU (#4631)

2025-03-23 22:58:05 -07:00

torch_extension.cc

[Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00