Huapeng Zhou
|
2f7420bc84
|
[Feat] Enable PDL automatically on Hopper architecture (#5981)
|
2025-06-01 12:30:17 -07:00 |
|
Yineng Zhang
|
b520d02888
|
chore: bump sgl-kernel v0.1.5 (#6794)
|
2025-05-31 14:54:00 -07:00 |
|
Qiaolin Yu
|
7dc0e39442
|
Bump torch to 2.7.0 (#6788)
|
2025-05-31 14:43:12 -07:00 |
|
ChangyiYang
|
485a023bd8
|
refactor apply_w8a8_block_fp8_linear in fp (#6545)
|
2025-05-29 00:15:11 -07:00 |
|
Qiaolin Yu
|
0b9557fcd7
|
Disable compiling arch below sm_90 in aarch64 by default (#6380)
|
2025-05-27 15:50:02 -07:00 |
|
Brayden Zhong
|
006ead9dcb
|
[FA][Test] Fix Sparse FA test (#6306)
|
2025-05-26 01:27:48 -07:00 |
|
Chunyuan WU
|
3ded6235c9
|
Add fp8 fused_experts kernel for CPU in sgl-kernel and add UT (#6404)
|
2025-05-23 02:01:55 -07:00 |
|
blzheng
|
4ba1eea83f
|
Add fp8 qkv_proj_with_rope kernel for CPU in sgl-kernel and add UT (#6493)
|
2025-05-23 00:14:46 -07:00 |
|
Yineng Zhang
|
d71f3f0a2a
|
chore: bump sgl-kernel v0.1.4 (#6522)
|
2025-05-22 09:47:42 -07:00 |
|
Yuan Luo
|
121f92c583
|
Add main for merge state tests (#6492)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-05-21 21:56:25 -07:00 |
|
HandH1998
|
4d643f6c7a
|
[1/2] Support Qserve (#6457)
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
|
2025-05-21 19:48:59 -07:00 |
|
blzheng
|
cfe48c5902
|
[CPU] Fix build issue (#6419)
|
2025-05-21 11:17:10 -07:00 |
|
YanbingJiang
|
32cc66efa5
|
Update extend/decode attention kernel for CPU in sgl-kernel and add UTs (#6405)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
|
2025-05-19 21:23:17 -07:00 |
|
Chunyuan WU
|
5dd62c3a6f
|
Add fp8 shared_expert kernel for CPU in sgl-kernel and add UT (#6339)
Co-authored-by: Jiang, Yanbing <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
|
2025-05-18 12:42:15 -07:00 |
|
Yineng Zhang
|
3d7f7a43c8
|
chore: bump sgl-kernel v0.1.3 (#6368)
|
2025-05-17 00:15:55 -07:00 |
|
Elfie Guo
|
6fc9357503
|
[2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694)
|
2025-05-16 13:14:07 -07:00 |
|
Elfie Guo
|
c23a7072b6
|
Upgrade CUTLASS 4.0 (#6336)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-05-15 17:42:23 -07:00 |
|
Chunyuan WU
|
fb4959b2c5
|
Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216)
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
|
2025-05-15 09:10:40 -07:00 |
|
blzheng
|
0f75b907c6
|
[CPU] Add CMakeLists.txt for sgl-kernel (#6115)
|
2025-05-13 15:30:37 -07:00 |
|
Lianmin Zheng
|
e8e18dcdcc
|
Revert "fix some typos" (#6244)
|
2025-05-12 12:53:26 -07:00 |
|
applesaucethebun
|
d738ab52f8
|
fix some typos (#6209)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-05-13 01:42:38 +08:00 |
|
Yineng Zhang
|
45b4dcf037
|
chore: bump sgl-kernel v0.1.2.post1 (#6195)
|
2025-05-11 02:24:10 -07:00 |
|
Yineng Zhang
|
213e8c7dd5
|
chore: upgrade deepgemm (#6073)
|
2025-05-11 02:17:24 -07:00 |
|
applesaucethebun
|
2ce8793519
|
Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-05-11 12:55:00 +08:00 |
|
Trevor Morris
|
0ab3f437ab
|
Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101)
|
2025-05-08 18:44:30 -07:00 |
|
Yineng Zhang
|
6578cf27de
|
chore: bump sgl-kernel 0.1.2 (#6131)
|
2025-05-08 15:16:28 -07:00 |
|
Stefan He
|
087751a8f2
|
Remove unecessary is_fa3_supported check (#6112)
|
2025-05-08 14:45:33 -07:00 |
|
PGFLMG
|
f6f96b0521
|
[sgl-kernel] fix: fix cu118 compile error (#6123)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-05-08 14:26:51 -07:00 |
|
Johnny
|
cb69194562
|
feat: add release workflow for SGLang kernels on aarch64 (#6010)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-05-06 19:42:07 -07:00 |
|
Xiaoyu Zhang
|
d25398cbc8
|
fix custom_allreduce namespace (#6039)
|
2025-05-06 19:13:06 -07:00 |
|
Qiaolin Yu
|
aff584fa54
|
Fix sgl-kernel build on aarch64 platforms (#6062)
|
2025-05-06 16:10:57 -07:00 |
|
Yineng Zhang
|
6f56614734
|
chore: upgrade cutlass 3.9.2 (#6004)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-05-06 13:34:08 -07:00 |
|
Johnny
|
9f21e75453
|
add Thor & Spark (#5915)
|
2025-04-30 19:43:40 -07:00 |
|
Yineng Zhang
|
d353d08b4e
|
chore: bump sgl-kernel 0.1.1 (#5932)
|
2025-04-30 14:01:49 -07:00 |
|
PGFLMG
|
08acdb5c3d
|
[Feat] Scale up fa3 kernel to sm8x arch (#5912)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-04-30 13:59:36 -07:00 |
|
PGFLMG
|
3ddf5b9d61
|
[Misc] use parallel build for cmake in sgl-kernel (#5919)
|
2025-04-30 08:56:46 -07:00 |
|
zhjunqin
|
403b855a22
|
Add sm_120 for blackwell (#5903)
|
2025-04-29 20:45:24 -07:00 |
|
Yineng Zhang
|
a043f7f2ab
|
chore: use torch 2.6 for sgl-kernel build (#5898)
|
2025-04-29 17:51:18 -07:00 |
|
Johnny
|
2c7dbb7cc2
|
[FEATURE] Enhance platform compatibility for ARM (#5746)
|
2025-04-29 15:06:16 -07:00 |
|
Xiaoyu Zhang
|
5bb0accbcf
|
cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820)
|
2025-04-28 21:52:36 -07:00 |
|
PGFLMG
|
ee71ed8a41
|
[Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)
Co-authored-by: sighingnow <sighingnow@gmail.com>
|
2025-04-28 11:03:17 -07:00 |
|
Xiaoyu Zhang
|
ef15dcda26
|
Add a doc to fix sgl-kernel build link error in py39 with ccache (#5809)
|
2025-04-27 21:34:27 -07:00 |
|
Trevor Morris
|
84810da4ae
|
Add Cutlass MLA attention backend (#5390)
|
2025-04-27 20:58:53 -07:00 |
|
Yineng Zhang
|
7d0edf3cae
|
chore: bump sgl-kernel 0.1.0 (#5688)
|
2025-04-23 14:23:59 -07:00 |
|
Yineng Zhang
|
ce4ecba477
|
fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686)
|
2025-04-23 14:17:42 -07:00 |
|
Yineng Zhang
|
15fabcc07f
|
fix sgl-kernel unit tests (#5666)
|
2025-04-23 01:18:30 -07:00 |
|
Elfie Guo
|
e62c49557d
|
[1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281)
|
2025-04-22 22:28:20 -07:00 |
|
Yubo Wang
|
20f1c8e374
|
Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546)
|
2025-04-19 21:47:23 -07:00 |
|
Yineng Zhang
|
f28d82997a
|
chore: bump sgl-kernel 0.0.9.post2 (#5518)
|
2025-04-17 23:42:39 -07:00 |
|
Xiaoyu Zhang
|
8e09b37077
|
Sgl kernel fused_moe_gate support n_shared_experts (#5440)
|
2025-04-17 23:05:15 -07:00 |
|