EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
3,805 Commits 8 Branches 0 Tags
34c3f9b2d32787a5be6ab344904cb6ce418a3c8b
Commit Graph

89 Commits

Author SHA1 Message Date
Zhiqiang Xie
34c3f9b2d3 kvcache io kernels and test case (#7382) 2025-06-23 11:58:59 -07:00
Lianmin Zheng
55e03b10c4 Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457) 2025-06-23 06:20:39 -07:00
Lianmin Zheng
8321f8e45e Release sgl-kernel 0.1.9 (#7232) 2025-06-16 03:37:40 -07:00
Lianmin Zheng
cfceb83d05 Fix sampling for speculative decoding & simplify kernels (#7207) 2025-06-16 03:28:30 -07:00
Yineng Zhang
4473320380 chore: bump v0.1.8.post2 (#7189) 2025-06-14 17:01:48 -07:00
JieXin Liang
ab1a4fa5cb [fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184) 2025-06-14 12:45:41 -07:00
Yineng Zhang
8ab7d93c2e chore: bump v0.1.8.post1 (#7152) 2025-06-13 03:14:26 -07:00
fzyzcjy
5c66c4424f Support new DeepGEMM format in per token group quant (#7146) 2025-06-13 02:00:22 -07:00
fzyzcjy
aa46ed34d2 Remove 200us slow concat kernel (part 1: kernel) (#7145) 2025-06-13 01:58:29 -07:00
Yineng Zhang
7046e0fab7 feat: update blackwell setup (#7119) 2025-06-12 01:54:40 -07:00
Yuan Luo
84727a5139 [sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-06-11 20:43:08 -07:00
JieXin Liang
18efb5e8e0 [perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128 (#6929) 2025-06-08 19:37:34 -07:00
Yineng Zhang
6c0a48282a chore: bump sgl-kernel v0.1.7 (#6963) 2025-06-08 02:43:15 -07:00
Yineng Zhang
8db3ac55a9 chore: bump sgl-kernel v0.1.6.post1 (#6955) 2025-06-07 15:25:46 -07:00
Elfie Guo
3e56f557fd Add a CUDA kernel for fusing mapping and weighted sum for MoE. (#6916) 
Co-authored-by: Elfie Guo <elfiegxf@gmail.com>
 2025-06-07 15:24:39 -07:00
Yineng Zhang
d664ca18f2 chore: bump sgl-kernel v0.1.6 (#6943) 2025-06-07 00:25:22 -07:00
Pavani Majety
0df6765c83 [CUTLASS-FP4-MOE] Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887) 
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
 2025-06-05 13:13:14 -07:00
Yuan Luo
43baba649e [EP] Add cuda kernel for moe_ep_post_reorder (#6837) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-06-05 00:33:47 -07:00
zyksir
8e3797be1c support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) 2025-06-04 22:11:24 -07:00
Cheng Wan
81964328b7 Set num_fused_shared_experts as num_shared_experts when shared_experts fusion is not disabled (#6736) 2025-06-04 15:53:22 -07:00
Cheng Wan
8a5480528d [Refactor] Rename n_share_experts_fusion as num_fused_shared_experts (#6735) 2025-06-03 17:48:24 -07:00
Pavani Majety
eb38c7d1ca [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) 
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
 2025-06-02 13:48:03 -07:00
Yuan Luo
55444ed667 [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-06-01 20:49:01 -07:00
Wenxuan Tan
c429919def misc: cache is_hopper_arch (#6799) 2025-06-01 15:28:31 -07:00
Huapeng Zhou
2f7420bc84 [Feat] Enable PDL automatically on Hopper architecture (#5981) 2025-06-01 12:30:17 -07:00
Yineng Zhang
b520d02888 chore: bump sgl-kernel v0.1.5 (#6794) 2025-05-31 14:54:00 -07:00
Yineng Zhang
d71f3f0a2a chore: bump sgl-kernel v0.1.4 (#6522) 2025-05-22 09:47:42 -07:00
HandH1998
4d643f6c7a [1/2] Support Qserve (#6457) 
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
 2025-05-21 19:48:59 -07:00
Yineng Zhang
3d7f7a43c8 chore: bump sgl-kernel v0.1.3 (#6368) 2025-05-17 00:15:55 -07:00
Elfie Guo
6fc9357503 [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) 2025-05-16 13:14:07 -07:00
Lianmin Zheng
e8e18dcdcc Revert "fix some typos" (#6244) 2025-05-12 12:53:26 -07:00
applesaucethebun
d738ab52f8 fix some typos (#6209) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-05-13 01:42:38 +08:00
Yineng Zhang
45b4dcf037 chore: bump sgl-kernel v0.1.2.post1 (#6195) 2025-05-11 02:24:10 -07:00
applesaucethebun
2ce8793519 Add typo checker in pre-commit (#6179) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-05-11 12:55:00 +08:00
Yineng Zhang
6578cf27de chore: bump sgl-kernel 0.1.2 (#6131) 2025-05-08 15:16:28 -07:00
Stefan He
087751a8f2 Remove unecessary is_fa3_supported check (#6112) 2025-05-08 14:45:33 -07:00
Yineng Zhang
d353d08b4e chore: bump sgl-kernel 0.1.1 (#5932) 2025-04-30 14:01:49 -07:00
PGFLMG
08acdb5c3d [Feat] Scale up fa3 kernel to sm8x arch (#5912) 
Co-authored-by: zhyncs <me@zhyncs.com>
 2025-04-30 13:59:36 -07:00
Johnny
2c7dbb7cc2 [FEATURE] Enhance platform compatibility for ARM (#5746) 2025-04-29 15:06:16 -07:00
PGFLMG
ee71ed8a41 [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) 
Co-authored-by: sighingnow <sighingnow@gmail.com>
 2025-04-28 11:03:17 -07:00
Trevor Morris
84810da4ae Add Cutlass MLA attention backend (#5390) 2025-04-27 20:58:53 -07:00
Yineng Zhang
7d0edf3cae chore: bump sgl-kernel 0.1.0 (#5688) 2025-04-23 14:23:59 -07:00
Yineng Zhang
15fabcc07f fix sgl-kernel unit tests (#5666) 2025-04-23 01:18:30 -07:00
Elfie Guo
e62c49557d [1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281) 2025-04-22 22:28:20 -07:00
Yubo Wang
20f1c8e374 Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546) 2025-04-19 21:47:23 -07:00
Yineng Zhang
f28d82997a chore: bump sgl-kernel 0.0.9.post2 (#5518) 2025-04-17 23:42:39 -07:00
Xiaoyu Zhang
8e09b37077 Sgl kernel fused_moe_gate support n_shared_experts (#5440) 2025-04-17 23:05:15 -07:00
PGFLMG
c08a717c77 [Feat] Update sgl-kernel flashinfer to latest main version (#5500) 
Co-authored-by: zhyncs <me@zhyncs.com>
 2025-04-17 12:43:23 -07:00
Trevor Morris
e8f62b20ca BLackwell cutlass mla: Add check for bad page size/block num combinations (#5431) 2025-04-15 14:07:42 -07:00
Yineng Zhang
6f509d5503 chore: bump sgl-kernel v0.0.9.post1 (#5430) 2025-04-15 11:00:21 -07:00