16 Commits

Author SHA1 Message Date
Lifu Huang
e98d9346c7 [1/2] Support FA4 for MHA Prefill in sgl-kernel (#10940) 2025-09-28 19:59:14 -07:00
Lianmin Zheng
35ec2a45a8 [minor] Remove deprecated function get_ip (#10883) 2025-09-25 16:18:04 -07:00
fzyzcjy
ca63f075b7 Revert "Fix FA4 import cause moe_fused_gate output be illegal memory" (#10432) 2025-09-14 19:03:27 -07:00
fzyzcjy
3a77c80b26 Fix FA4 import cause moe_fused_gate output be illegal memory (#10368) 2025-09-12 03:21:26 -07:00
Yineng Zhang
94fb4e9e54 feat: support fa cute in sgl-kernel (#10205)
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
2025-09-09 00:14:39 -07:00
Yichen Yan
c9bf3877a0 Reduce overhead for fa by not calling heavy CUDA property check (#7375) 2025-08-20 16:26:28 +08:00
Ke Bao
94f44b88d1 Update fa3 interface and add unit test (#9150) 2025-08-13 20:05:02 +08:00
Lianmin Zheng
e8e18dcdcc Revert "fix some typos" (#6244) 2025-05-12 12:53:26 -07:00
applesaucethebun
d738ab52f8 fix some typos (#6209)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-13 01:42:38 +08:00
applesaucethebun
2ce8793519 Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-11 12:55:00 +08:00
Stefan He
087751a8f2 Remove unecessary is_fa3_supported check (#6112) 2025-05-08 14:45:33 -07:00
PGFLMG
08acdb5c3d [Feat] Scale up fa3 kernel to sm8x arch (#5912)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-04-30 13:59:36 -07:00
Baizhou Zhang
e4155e96d0 Add flash_attn_varlen_func to sgl-kernel (#5315) 2025-04-11 23:36:36 -07:00
Yineng Zhang
4f288113ce fix: update flash attn (#5308) 2025-04-11 16:23:09 -07:00
yinfan98
b8b6008f47 [Fix] fix fa3 build at cu118 (#5036) 2025-04-03 11:52:35 -07:00
yinfan98
37c66ec856 [feat] add fa3 in sgl-kernel (#4902)
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
2025-03-30 12:57:10 -07:00