EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
3,646 Commits 8 Branches 0 Tags
f2a75a66c4e5bd007ce0eabd4fb16edade751e6c
Commit Graph

331 Commits

Author SHA1 Message Date
Yineng Zhang
344adb00ec fix arm sgl-kernel link issue (#7066) 2025-06-10 15:23:22 -07:00
fzyzcjy
19995dd78e Tiny fix cutlass_mla_get_workspace_size stub incorrect signature (#7057) 2025-06-10 12:27:57 -07:00
YanbingJiang
fcde67b016 CPU: map changes from developing branch in sgl-kernel (#6833) 
Co-authored-by: mingfeima <mingfei.ma@intel.com>
 2025-06-10 01:08:15 -07:00
JieXin Liang
18efb5e8e0 [perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128 (#6929) 2025-06-08 19:37:34 -07:00
Yineng Zhang
6c0a48282a chore: bump sgl-kernel v0.1.7 (#6963) 2025-06-08 02:43:15 -07:00
Yineng Zhang
8db3ac55a9 chore: bump sgl-kernel v0.1.6.post1 (#6955) 2025-06-07 15:25:46 -07:00
Elfie Guo
3e56f557fd Add a CUDA kernel for fusing mapping and weighted sum for MoE. (#6916) 
Co-authored-by: Elfie Guo <elfiegxf@gmail.com>
 2025-06-07 15:24:39 -07:00
Xiaoyu Zhang
8b5f83ed3b reduce torch.zeros overhead in moe align block size kernel (#6369) 2025-06-07 02:47:36 -07:00
Yineng Zhang
d664ca18f2 chore: bump sgl-kernel v0.1.6 (#6943) 2025-06-07 00:25:22 -07:00
JieXin Liang
22fe787852 [sgl-kernel] update deepgemm (#6942) 2025-06-06 23:24:41 -07:00
Pavani Majety
0df6765c83 [CUTLASS-FP4-MOE] Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887) 
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
 2025-06-05 13:13:14 -07:00
Yuan Luo
43baba649e [EP] Add cuda kernel for moe_ep_post_reorder (#6837) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-06-05 00:33:47 -07:00
zyksir
8e3797be1c support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) 2025-06-04 22:11:24 -07:00
Cheng Wan
81964328b7 Set num_fused_shared_experts as num_shared_experts when shared_experts fusion is not disabled (#6736) 2025-06-04 15:53:22 -07:00
Xiaoyu Zhang
bd75690f4e fix ep_moe_reorder kernel bugs (#6858) 
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
 2025-06-04 19:13:59 +08:00
Cheng Wan
8a5480528d [Refactor] Rename n_share_experts_fusion as num_fused_shared_experts (#6735) 2025-06-03 17:48:24 -07:00
jianan-gu
ff00895c46 Add CPU optimized kernels for topk and rope fusions (#6456) 2025-06-02 17:37:34 -07:00
Pavani Majety
eb38c7d1ca [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) 
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
 2025-06-02 13:48:03 -07:00
Yuan Luo
55444ed667 [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-06-01 20:49:01 -07:00
Wenxuan Tan
c429919def misc: cache is_hopper_arch (#6799) 2025-06-01 15:28:31 -07:00
Huapeng Zhou
2f7420bc84 [Feat] Enable PDL automatically on Hopper architecture (#5981) 2025-06-01 12:30:17 -07:00
Yineng Zhang
b520d02888 chore: bump sgl-kernel v0.1.5 (#6794) 2025-05-31 14:54:00 -07:00
Qiaolin Yu
7dc0e39442 Bump torch to 2.7.0 (#6788) 2025-05-31 14:43:12 -07:00
ChangyiYang
485a023bd8 refactor apply_w8a8_block_fp8_linear in fp (#6545) 2025-05-29 00:15:11 -07:00
Qiaolin Yu
0b9557fcd7 Disable compiling arch below sm_90 in aarch64 by default (#6380) 2025-05-27 15:50:02 -07:00
Brayden Zhong
006ead9dcb [FA][Test] Fix Sparse FA test (#6306) 2025-05-26 01:27:48 -07:00
Chunyuan WU
3ded6235c9 Add fp8 fused_experts kernel for CPU in sgl-kernel and add UT (#6404) 2025-05-23 02:01:55 -07:00
blzheng
4ba1eea83f Add fp8 qkv_proj_with_rope kernel for CPU in sgl-kernel and add UT (#6493) 2025-05-23 00:14:46 -07:00
Yineng Zhang
d71f3f0a2a chore: bump sgl-kernel v0.1.4 (#6522) 2025-05-22 09:47:42 -07:00
Yuan Luo
121f92c583 Add main for merge state tests (#6492) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-05-21 21:56:25 -07:00
HandH1998
4d643f6c7a [1/2] Support Qserve (#6457) 
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
 2025-05-21 19:48:59 -07:00
blzheng
cfe48c5902 [CPU] Fix build issue (#6419) 2025-05-21 11:17:10 -07:00
YanbingJiang
32cc66efa5 Update extend/decode attention kernel for CPU in sgl-kernel and add UTs (#6405) 
Co-authored-by: mingfeima <mingfei.ma@intel.com>
 2025-05-19 21:23:17 -07:00
Chunyuan WU
5dd62c3a6f Add fp8 shared_expert kernel for CPU in sgl-kernel and add UT (#6339) 
Co-authored-by: Jiang, Yanbing <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
 2025-05-18 12:42:15 -07:00
Yineng Zhang
3d7f7a43c8 chore: bump sgl-kernel v0.1.3 (#6368) 2025-05-17 00:15:55 -07:00
Elfie Guo
6fc9357503 [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) 2025-05-16 13:14:07 -07:00
Elfie Guo
c23a7072b6 Upgrade CUTLASS 4.0 (#6336) 
Co-authored-by: zhyncs <me@zhyncs.com>
 2025-05-15 17:42:23 -07:00
Chunyuan WU
fb4959b2c5 Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) 
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
 2025-05-15 09:10:40 -07:00
blzheng
0f75b907c6 [CPU] Add CMakeLists.txt for sgl-kernel (#6115) 2025-05-13 15:30:37 -07:00
Lianmin Zheng
e8e18dcdcc Revert "fix some typos" (#6244) 2025-05-12 12:53:26 -07:00
applesaucethebun
d738ab52f8 fix some typos (#6209) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-05-13 01:42:38 +08:00
Yineng Zhang
45b4dcf037 chore: bump sgl-kernel v0.1.2.post1 (#6195) 2025-05-11 02:24:10 -07:00
Yineng Zhang
213e8c7dd5 chore: upgrade deepgemm (#6073) 2025-05-11 02:17:24 -07:00
applesaucethebun
2ce8793519 Add typo checker in pre-commit (#6179) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-05-11 12:55:00 +08:00
Trevor Morris
0ab3f437ab Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101) 2025-05-08 18:44:30 -07:00
Yineng Zhang
6578cf27de chore: bump sgl-kernel 0.1.2 (#6131) 2025-05-08 15:16:28 -07:00
Stefan He
087751a8f2 Remove unecessary is_fa3_supported check (#6112) 2025-05-08 14:45:33 -07:00
PGFLMG
f6f96b0521 [sgl-kernel] fix: fix cu118 compile error (#6123) 
Co-authored-by: zhyncs <me@zhyncs.com>
 2025-05-08 14:26:51 -07:00
Johnny
cb69194562 feat: add release workflow for SGLang kernels on aarch64 (#6010) 
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
 2025-05-06 19:42:07 -07:00
Xiaoyu Zhang
d25398cbc8 fix custom_allreduce namespace (#6039) 2025-05-06 19:13:06 -07:00