Yineng Zhang
|
637bfee448
|
chore: bump sgl-kernel v0.2.1 (#7675)
|
2025-06-30 22:12:33 -07:00 |
|
Baizhou Zhang
|
7248272ccc
|
Add dsv3 router gemm kernel (#7627)
|
2025-06-29 23:31:55 -07:00 |
|
Ke Bao
|
04b35190e2
|
Add dsv3 fused a gemm to sgl-kernel (#7630)
|
2025-06-29 02:52:24 -07:00 |
|
Ke Bao
|
57ab776910
|
Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437)
|
2025-06-24 17:44:27 -07:00 |
|
Yineng Zhang
|
e846d95ef6
|
chore: bump sgl-kernel v0.2.0 (#7490)
|
2025-06-23 22:29:50 -07:00 |
|
Zhiqiang Xie
|
34c3f9b2d3
|
kvcache io kernels and test case (#7382)
|
2025-06-23 11:58:59 -07:00 |
|
Lianmin Zheng
|
55e03b10c4
|
Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457)
|
2025-06-23 06:20:39 -07:00 |
|
Lianmin Zheng
|
8321f8e45e
|
Release sgl-kernel 0.1.9 (#7232)
|
2025-06-16 03:37:40 -07:00 |
|
Lianmin Zheng
|
cfceb83d05
|
Fix sampling for speculative decoding & simplify kernels (#7207)
|
2025-06-16 03:28:30 -07:00 |
|
Yineng Zhang
|
4473320380
|
chore: bump v0.1.8.post2 (#7189)
|
2025-06-14 17:01:48 -07:00 |
|
JieXin Liang
|
ab1a4fa5cb
|
[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)
|
2025-06-14 12:45:41 -07:00 |
|
Yineng Zhang
|
8ab7d93c2e
|
chore: bump v0.1.8.post1 (#7152)
|
2025-06-13 03:14:26 -07:00 |
|
fzyzcjy
|
5c66c4424f
|
Support new DeepGEMM format in per token group quant (#7146)
|
2025-06-13 02:00:22 -07:00 |
|
fzyzcjy
|
aa46ed34d2
|
Remove 200us slow concat kernel (part 1: kernel) (#7145)
|
2025-06-13 01:58:29 -07:00 |
|
Yineng Zhang
|
7046e0fab7
|
feat: update blackwell setup (#7119)
|
2025-06-12 01:54:40 -07:00 |
|
Yuan Luo
|
84727a5139
|
[sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-06-11 20:43:08 -07:00 |
|
JieXin Liang
|
18efb5e8e0
|
[perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128 (#6929)
|
2025-06-08 19:37:34 -07:00 |
|
Yineng Zhang
|
6c0a48282a
|
chore: bump sgl-kernel v0.1.7 (#6963)
|
2025-06-08 02:43:15 -07:00 |
|
Yineng Zhang
|
8db3ac55a9
|
chore: bump sgl-kernel v0.1.6.post1 (#6955)
|
2025-06-07 15:25:46 -07:00 |
|
Elfie Guo
|
3e56f557fd
|
Add a CUDA kernel for fusing mapping and weighted sum for MoE. (#6916)
Co-authored-by: Elfie Guo <elfiegxf@gmail.com>
|
2025-06-07 15:24:39 -07:00 |
|
Yineng Zhang
|
d664ca18f2
|
chore: bump sgl-kernel v0.1.6 (#6943)
|
2025-06-07 00:25:22 -07:00 |
|
Pavani Majety
|
0df6765c83
|
[CUTLASS-FP4-MOE] Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
|
2025-06-05 13:13:14 -07:00 |
|
Yuan Luo
|
43baba649e
|
[EP] Add cuda kernel for moe_ep_post_reorder (#6837)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-06-05 00:33:47 -07:00 |
|
zyksir
|
8e3797be1c
|
support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)
|
2025-06-04 22:11:24 -07:00 |
|
Cheng Wan
|
81964328b7
|
Set num_fused_shared_experts as num_shared_experts when shared_experts fusion is not disabled (#6736)
|
2025-06-04 15:53:22 -07:00 |
|
Cheng Wan
|
8a5480528d
|
[Refactor] Rename n_share_experts_fusion as num_fused_shared_experts (#6735)
|
2025-06-03 17:48:24 -07:00 |
|
Pavani Majety
|
eb38c7d1ca
|
[1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
|
2025-06-02 13:48:03 -07:00 |
|
Yuan Luo
|
55444ed667
|
[EP] Add cuda kernel for moe_ep_pre_reorder (#6699)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-06-01 20:49:01 -07:00 |
|
Wenxuan Tan
|
c429919def
|
misc: cache is_hopper_arch (#6799)
|
2025-06-01 15:28:31 -07:00 |
|
Huapeng Zhou
|
2f7420bc84
|
[Feat] Enable PDL automatically on Hopper architecture (#5981)
|
2025-06-01 12:30:17 -07:00 |
|
Yineng Zhang
|
b520d02888
|
chore: bump sgl-kernel v0.1.5 (#6794)
|
2025-05-31 14:54:00 -07:00 |
|
Yineng Zhang
|
d71f3f0a2a
|
chore: bump sgl-kernel v0.1.4 (#6522)
|
2025-05-22 09:47:42 -07:00 |
|
HandH1998
|
4d643f6c7a
|
[1/2] Support Qserve (#6457)
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
|
2025-05-21 19:48:59 -07:00 |
|
Yineng Zhang
|
3d7f7a43c8
|
chore: bump sgl-kernel v0.1.3 (#6368)
|
2025-05-17 00:15:55 -07:00 |
|
Elfie Guo
|
6fc9357503
|
[2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694)
|
2025-05-16 13:14:07 -07:00 |
|
Lianmin Zheng
|
e8e18dcdcc
|
Revert "fix some typos" (#6244)
|
2025-05-12 12:53:26 -07:00 |
|
applesaucethebun
|
d738ab52f8
|
fix some typos (#6209)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-05-13 01:42:38 +08:00 |
|
Yineng Zhang
|
45b4dcf037
|
chore: bump sgl-kernel v0.1.2.post1 (#6195)
|
2025-05-11 02:24:10 -07:00 |
|
applesaucethebun
|
2ce8793519
|
Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-05-11 12:55:00 +08:00 |
|
Yineng Zhang
|
6578cf27de
|
chore: bump sgl-kernel 0.1.2 (#6131)
|
2025-05-08 15:16:28 -07:00 |
|
Stefan He
|
087751a8f2
|
Remove unecessary is_fa3_supported check (#6112)
|
2025-05-08 14:45:33 -07:00 |
|
Yineng Zhang
|
d353d08b4e
|
chore: bump sgl-kernel 0.1.1 (#5932)
|
2025-04-30 14:01:49 -07:00 |
|
PGFLMG
|
08acdb5c3d
|
[Feat] Scale up fa3 kernel to sm8x arch (#5912)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-04-30 13:59:36 -07:00 |
|
Johnny
|
2c7dbb7cc2
|
[FEATURE] Enhance platform compatibility for ARM (#5746)
|
2025-04-29 15:06:16 -07:00 |
|
PGFLMG
|
ee71ed8a41
|
[Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)
Co-authored-by: sighingnow <sighingnow@gmail.com>
|
2025-04-28 11:03:17 -07:00 |
|
Trevor Morris
|
84810da4ae
|
Add Cutlass MLA attention backend (#5390)
|
2025-04-27 20:58:53 -07:00 |
|
Yineng Zhang
|
7d0edf3cae
|
chore: bump sgl-kernel 0.1.0 (#5688)
|
2025-04-23 14:23:59 -07:00 |
|
Yineng Zhang
|
15fabcc07f
|
fix sgl-kernel unit tests (#5666)
|
2025-04-23 01:18:30 -07:00 |
|
Elfie Guo
|
e62c49557d
|
[1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281)
|
2025-04-22 22:28:20 -07:00 |
|
Yubo Wang
|
20f1c8e374
|
Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546)
|
2025-04-19 21:47:23 -07:00 |
|