Commit Graph

292 Commits

Author SHA1 Message Date
Lianmin Zheng
e8e18dcdcc Revert "fix some typos" (#6244) 2025-05-12 12:53:26 -07:00
applesaucethebun
d738ab52f8 fix some typos (#6209)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-13 01:42:38 +08:00
Yineng Zhang
45b4dcf037 chore: bump sgl-kernel v0.1.2.post1 (#6195) 2025-05-11 02:24:10 -07:00
Yineng Zhang
213e8c7dd5 chore: upgrade deepgemm (#6073) 2025-05-11 02:17:24 -07:00
applesaucethebun
2ce8793519 Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-11 12:55:00 +08:00
Trevor Morris
0ab3f437ab Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101) 2025-05-08 18:44:30 -07:00
Yineng Zhang
6578cf27de chore: bump sgl-kernel 0.1.2 (#6131) 2025-05-08 15:16:28 -07:00
Stefan He
087751a8f2 Remove unecessary is_fa3_supported check (#6112) 2025-05-08 14:45:33 -07:00
PGFLMG
f6f96b0521 [sgl-kernel] fix: fix cu118 compile error (#6123)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-05-08 14:26:51 -07:00
Johnny
cb69194562 feat: add release workflow for SGLang kernels on aarch64 (#6010)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-05-06 19:42:07 -07:00
Xiaoyu Zhang
d25398cbc8 fix custom_allreduce namespace (#6039) 2025-05-06 19:13:06 -07:00
Qiaolin Yu
aff584fa54 Fix sgl-kernel build on aarch64 platforms (#6062) 2025-05-06 16:10:57 -07:00
Yineng Zhang
6f56614734 chore: upgrade cutlass 3.9.2 (#6004)
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-05-06 13:34:08 -07:00
Johnny
9f21e75453 add Thor & Spark (#5915) 2025-04-30 19:43:40 -07:00
Yineng Zhang
d353d08b4e chore: bump sgl-kernel 0.1.1 (#5932) 2025-04-30 14:01:49 -07:00
PGFLMG
08acdb5c3d [Feat] Scale up fa3 kernel to sm8x arch (#5912)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-04-30 13:59:36 -07:00
PGFLMG
3ddf5b9d61 [Misc] use parallel build for cmake in sgl-kernel (#5919) 2025-04-30 08:56:46 -07:00
zhjunqin
403b855a22 Add sm_120 for blackwell (#5903) 2025-04-29 20:45:24 -07:00
Yineng Zhang
a043f7f2ab chore: use torch 2.6 for sgl-kernel build (#5898) 2025-04-29 17:51:18 -07:00
Johnny
2c7dbb7cc2 [FEATURE] Enhance platform compatibility for ARM (#5746) 2025-04-29 15:06:16 -07:00
Xiaoyu Zhang
5bb0accbcf cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) 2025-04-28 21:52:36 -07:00
PGFLMG
ee71ed8a41 [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)
Co-authored-by: sighingnow <sighingnow@gmail.com>
2025-04-28 11:03:17 -07:00
Xiaoyu Zhang
ef15dcda26 Add a doc to fix sgl-kernel build link error in py39 with ccache (#5809) 2025-04-27 21:34:27 -07:00
Trevor Morris
84810da4ae Add Cutlass MLA attention backend (#5390) 2025-04-27 20:58:53 -07:00
Yineng Zhang
7d0edf3cae chore: bump sgl-kernel 0.1.0 (#5688) 2025-04-23 14:23:59 -07:00
Yineng Zhang
ce4ecba477 fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686) 2025-04-23 14:17:42 -07:00
Yineng Zhang
15fabcc07f fix sgl-kernel unit tests (#5666) 2025-04-23 01:18:30 -07:00
Elfie Guo
e62c49557d [1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281) 2025-04-22 22:28:20 -07:00
Yubo Wang
20f1c8e374 Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546) 2025-04-19 21:47:23 -07:00
Yineng Zhang
f28d82997a chore: bump sgl-kernel 0.0.9.post2 (#5518) 2025-04-17 23:42:39 -07:00
Xiaoyu Zhang
8e09b37077 Sgl kernel fused_moe_gate support n_shared_experts (#5440) 2025-04-17 23:05:15 -07:00
PGFLMG
c08a717c77 [Feat] Update sgl-kernel flashinfer to latest main version (#5500)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-04-17 12:43:23 -07:00
Michael Yao
22c2a79dc5 Fix a link in sgl-kernel/README.md (#5493) 2025-04-17 02:25:28 -07:00
Baizhou Zhang
81c891111f Add test for flash_attn_varlen_func kernel (#5484) 2025-04-17 01:42:56 -07:00
Elfie Guo
85ec0440a5 Update cutlass dependency. (#5447) 2025-04-15 23:28:04 -07:00
Trevor Morris
e8f62b20ca BLackwell cutlass mla: Add check for bad page size/block num combinations (#5431) 2025-04-15 14:07:42 -07:00
Yineng Zhang
88defc4d89 fix: solve release issue (#5434) 2025-04-15 12:58:11 -07:00
Yineng Zhang
6f509d5503 chore: bump sgl-kernel v0.0.9.post1 (#5430) 2025-04-15 11:00:21 -07:00
DefTruth
12ef7e3bc3 bugfix: fix merge_state_v2 cuda graph (#5419) 2025-04-15 10:18:47 -07:00
Lianmin Zheng
838fa0f218 [minor] cleanup cmakelists.txt (#5420) 2025-04-15 07:07:07 -07:00
Yineng Zhang
e940dc4f06 chore: bump sgl-kernel 0.0.9 (#5400) 2025-04-14 21:34:04 -07:00
DefTruth
388e15c0db kernel: support slightly faster merge_state_v2 cuda kernel (#5381) 2025-04-14 21:28:23 -07:00
Yineng Zhang
6c41fcf0e4 chore: upgrade DeepGEMM (#5395) 2025-04-14 20:32:46 -07:00
Lianmin Zheng
dae7944440 minor clean up of sgl-kernel/CMakeLists.txt (#5393) 2025-04-14 18:38:44 -07:00
Yineng Zhang
b62e7e99b8 feat: adapt merge_state (#5337) 2025-04-12 21:14:04 -07:00
Yineng Zhang
b371f7cd36 chore: bump sgl-kernel v0.0.8.post3 (#5332) 2025-04-12 12:53:37 -07:00
Yineng Zhang
812e82f35e fix: solve cu118 issue for cutlass mla (#5331) 2025-04-12 12:51:09 -07:00
PGFLMG
4879e50c6d [Feat] Add sparse attn to sgl-kernel (#5327) 2025-04-12 11:36:36 -07:00
Yineng Zhang
115ae2e728 chore: bump sgl-kernel v0.0.8.post2 (#5317) 2025-04-11 23:42:03 -07:00
Baizhou Zhang
e4155e96d0 Add flash_attn_varlen_func to sgl-kernel (#5315) 2025-04-11 23:36:36 -07:00