Zhiqiang Xie 34c3f9b2d3 kvcache io kernels and test case (#7382)

2025-06-23 11:58:59 -07:00

..

__init__.py

kvcache io kernels and test case (#7382)

2025-06-23 11:58:59 -07:00

allreduce.py

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

attention.py

[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)

2025-06-14 12:45:41 -07:00

elementwise.py

[Feat] Enable PDL automatically on Hopper architecture (#5981)

2025-06-01 12:30:17 -07:00

flash_attn.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

gemm.py

Support new DeepGEMM format in per token group quant (#7146)

2025-06-13 02:00:22 -07:00

grammar.py

fix sgl-kernel unit tests (#5666)

2025-04-23 01:18:30 -07:00

kvcacheio.py

kvcache io kernels and test case (#7382)

2025-06-23 11:58:59 -07:00

moe.py

[sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919)

2025-06-11 20:43:08 -07:00

sampling.py

Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457)

2025-06-23 06:20:39 -07:00

sparse_flash_attn.py

[Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)

2025-04-28 11:03:17 -07:00

speculative.py

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

top_k.py

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

utils.py

misc: cache is_hopper_arch (#6799)

2025-06-01 15:28:31 -07:00

version.py

Release sgl-kernel 0.1.9 (#7232)

2025-06-16 03:37:40 -07:00