Ke Bao
|
a22f60a313
|
Add workflow for sgl-kernel cu118 release (#3109)
|
2025-01-24 22:30:30 +08:00 |
|
Yineng Zhang
|
04f0b4cbef
|
minor: update sgl-kernel setup (#3107)
|
2025-01-24 20:10:35 +08:00 |
|
Trevor Morris
|
685a5738a7
|
Allow local cutlass directory to be used in sgl-kernel build (#3037)
|
2025-01-24 03:59:47 -08:00 |
|
Yineng Zhang
|
153b414e83
|
minor: sync flashinfer and add turbomind as 3rdparty (#3105)
|
2025-01-24 19:22:39 +08:00 |
|
Ke Bao
|
6619f48e18
|
Fix cu118 group gemm compile issue (#3097)
|
2025-01-24 15:19:09 +08:00 |
|
Ke Bao
|
7bad7e75bf
|
Add shapes for int8 gemm benchmark (#3093)
|
2025-01-24 12:27:30 +08:00 |
|
Yineng Zhang
|
54bac8af0b
|
chore: bump sgl-kernel 0.0.2.post16 (#3087)
|
2025-01-24 01:57:48 +08:00 |
|
Yineng Zhang
|
5de4051bcf
|
feat: integrate sampling kernels into sgl-kernel (#3086)
Co-authored-by: Zihao Ye <expye@outlook.com>
|
2025-01-24 01:54:47 +08:00 |
|
Xiaoyu Zhang
|
e0cd65c2b6
|
[hotfix] fix test_sampling_scaling_penalties.py ci test (#3084)
|
2025-01-24 00:33:59 +08:00 |
|
Xiaoyu Zhang
|
f1b6861828
|
use flashinfer vec_dtypes in sgl_kernel (#3083)
|
2025-01-23 22:19:04 +08:00 |
|
Yineng Zhang
|
0da0989ad4
|
sync flashinfer and update sgl-kernel tests (#3081)
|
2025-01-23 21:13:55 +08:00 |
|
Yineng Zhang
|
07a22cbba3
|
use env variable to control the build conf on the CPU build node (#3080)
|
2025-01-23 20:46:49 +08:00 |
|
Yineng Zhang
|
3d0bfa3e17
|
update version setup for sgl-kernel (#3079)
|
2025-01-23 19:45:25 +08:00 |
|
Yineng Zhang
|
1f6cf0d4b9
|
fix build error for sgl-kernel (#3078)
|
2025-01-23 19:16:35 +08:00 |
|
Lianmin Zheng
|
553f5a3ffe
|
Remove torch dependency in sgl-kernel (#3074)
|
2025-01-23 17:23:37 +08:00 |
|
Xiaoyu Zhang
|
ac2dc35d0e
|
support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030)
|
2025-01-23 15:29:20 +08:00 |
|
Yineng Zhang
|
44e12ce463
|
docs: update developer guide for sgl-kernel (#3069)
|
2025-01-23 14:08:25 +08:00 |
|
Yineng Zhang
|
a547aad61f
|
docs: add developer guide for sgl-kernel (#3068)
|
2025-01-23 13:47:53 +08:00 |
|
Yineng Zhang
|
806a3002c1
|
add notice about flashinfer in sgl-kernel (#3057)
|
2025-01-23 02:47:36 +08:00 |
|
Yineng Zhang
|
bf669606eb
|
feat: integrate bmm_fp8 kernel into sgl-kernel (#3056)
|
2025-01-23 00:39:38 +08:00 |
|
Yineng Zhang
|
b2bd8f444c
|
minor: update header and use pytest (#3054)
|
2025-01-22 23:45:18 +08:00 |
|
Yineng Zhang
|
9d9b482a39
|
feat: integrate activation kernels into sgl-kernel (#3053)
|
2025-01-22 23:25:45 +08:00 |
|
Yineng Zhang
|
7353fb9b97
|
feat: integrate norm kernels into sgl-kernel (#3052)
|
2025-01-22 21:32:48 +08:00 |
|
Yineng Zhang
|
bcda0c9ee6
|
sync the upstream updates of flashinfer (#3051)
|
2025-01-22 20:33:13 +08:00 |
|
Yineng Zhang
|
9f8f2c7f74
|
update norm cu (#3048)
|
2025-01-22 18:58:44 +08:00 |
|
Ke Bao
|
6fc37bd8ee
|
Fix sgl-kernel compile for sm80 (#3046)
|
2025-01-22 16:49:08 +08:00 |
|
Ke Bao
|
0ac019f171
|
Support sm90 Int8 gemm (#3035)
|
2025-01-21 22:21:54 +08:00 |
|
Yineng Zhang
|
5a0d680a14
|
feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033)
|
2025-01-21 20:44:49 +08:00 |
|
Yineng Zhang
|
ec1c21cdc4
|
upgrade torch version for sgl-kernel (#3026)
|
2025-01-21 14:32:08 +08:00 |
|
Yineng Zhang
|
6c856b4f3a
|
minor: update Makefile for sgl-kernel (#3025)
|
2025-01-21 13:08:15 +08:00 |
|
Ke Bao
|
5dfcacfcb1
|
Add compile flags for cutlass 3.x (#3013)
Co-authored-by: HandH1998 <1335248067@qq.com>
|
2025-01-21 00:04:12 +08:00 |
|
Byron Hsu
|
b5caa22dfb
|
[kernel] port rope cuda kernel to sgl-kernel (#2993)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-01-20 20:58:51 +08:00 |
|
Yineng Zhang
|
a69cb5cff7
|
cleanup unused header in sgl_kernel (#2986)
|
2025-01-20 00:44:49 +08:00 |
|
Yineng Zhang
|
d33cbb7e58
|
remove cub and add cccl (#2976)
|
2025-01-19 15:51:27 +08:00 |
|
Yineng Zhang
|
e2cdc8a5b5
|
upgrade cutlass v3.7.0 (#2967)
|
2025-01-18 23:37:42 +08:00 |
|
lukec
|
6f98c586bd
|
fix sgl-kernel setup.py (#2963)
|
2025-01-18 18:50:37 +08:00 |
|
Yineng Zhang
|
7596417732
|
minor: use bear for compilation database (#2919)
|
2025-01-16 18:39:11 +08:00 |
|
Yineng Zhang
|
2dc957d421
|
fix setup for sgl kernel (#2917)
|
2025-01-16 18:17:34 +08:00 |
|
Yineng Zhang
|
b7f3fec13c
|
minor: rename bench for sgl kernel (#2909)
|
2025-01-16 05:55:43 +08:00 |
|
Yineng Zhang
|
a53454c55e
|
fix: sgl-kernel link cuda (#2906)
|
2025-01-16 04:53:23 +08:00 |
|
yizhang2077
|
6cb3974e77
|
optimize custom allreduce kernel (#2904)
|
2025-01-16 03:04:25 +08:00 |
|
Xiaoyu Zhang
|
f005758f2b
|
introduce CUB in sgl-kernel (#2887)
|
2025-01-14 19:48:59 +08:00 |
|
Xiaoyu Zhang
|
d08c77c434
|
Sampling penalties memory interface (#2870)
|
2025-01-13 23:09:00 +08:00 |
|
Xiaoyu Zhang
|
e2b16c4716
|
add sampling_scaling_penalties kernel (#2846)
|
2025-01-12 19:38:17 -08:00 |
|
Ke Bao
|
58f9060efe
|
Update int8 gemm config (#2774)
|
2025-01-07 19:47:37 +08:00 |
|
Ke Bao
|
0f3eb1d294
|
Support cutlass Int8 gemm (#2752)
|
2025-01-06 22:51:22 +08:00 |
|
Ke Bao
|
06dd2eab84
|
Remove unused var in moe_align_kernel (#2751)
|
2025-01-06 22:13:28 +08:00 |
|
Ke Bao
|
439f65809f
|
Fix sgl-kernel cu118 compile issue (#2750)
|
2025-01-06 21:59:31 +08:00 |
|
yizhang2077
|
3900a94afe
|
Support twoshot kernel (#2688)
|
2025-01-06 00:47:16 +08:00 |
|
Xiaoyu Zhang
|
ded9fcd09a
|
improve moe_align_kernel for deepseek v3 (#2735)
|
2025-01-06 00:28:22 +08:00 |
|