Yuan Luo 53dcc750b6 [sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060) ...

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

2025-08-14 10:56:36 -07:00

..

testing

Fuse writing KV buffer into rope kernel (part 1: sgl-kernel) (#9077)

2025-08-12 01:46:40 -07:00

__init__.py

[sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060)

2025-08-14 10:56:36 -07:00

allreduce.py

[Feature] Integrate quick allreduce and select the best allreduce implementation (#6619)

2025-07-24 20:48:42 -07:00

attention.py

[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)

2025-06-14 12:45:41 -07:00

cutlass_moe.py

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772)

2025-07-04 20:50:12 -07:00

elementwise.py

Fuse writing KV buffer into rope kernel (part 1: sgl-kernel) (#9077)

2025-08-12 01:46:40 -07:00

flash_attn.py

Update fa3 interface and add unit test (#9150)

2025-08-13 20:05:02 +08:00

fused_moe.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

gemm.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

grammar.py

fix sgl-kernel unit tests (#5666)

2025-04-23 01:18:30 -07:00

kvcacheio.py

fix page first per layer pf2lf kernel (#8915)

2025-08-09 17:16:11 -07:00

marlin.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

memory.py

[Feature] Support custom set kv buffer kernel (#8884)

2025-08-12 16:56:51 -07:00

moe.py

[1/2][resubmit again] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (#9088)

2025-08-12 20:12:38 -07:00

sampling.py

[sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060)

2025-08-14 10:56:36 -07:00

scalar_type.py

refactor: Move scalar_types.py to sgl-kernel to avoid circular import (#8720)

2025-08-07 19:22:16 -07:00

sparse_flash_attn.py

[Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)

2025-04-28 11:03:17 -07:00

spatial.py

[Bug] fix green context's incompatibility with cuda < 12.4 (#8701)

2025-08-02 15:23:11 -07:00

speculative.py

Add treemask mode to build_eagle_tree & release sgl-kernel 0.2.3 (#7756)

2025-07-05 12:17:05 -07:00

top_k.py

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

utils.py

Runtime check CUDA driver version to avoid unresolved green context symbols (#9021)

2025-08-12 09:26:10 -07:00

version.py

chore: bump sgl-kernel v0.3.5 (#9185)

2025-08-14 03:20:48 -07:00