simveit
|
98f768d194
|
update eagle-3 docs (#4796)
Co-authored-by: Yifan Zhang <zhangyif21@mails.tsinghua.edu.cn>
|
2025-04-03 15:24:41 -07:00 |
|
Yineng Zhang
|
d7954b7682
|
bump sgl-kernel v0.0.7 (#5046)
|
2025-04-03 13:38:13 -07:00 |
|
Lianmin Zheng
|
74885a848b
|
Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048)
|
2025-04-03 13:30:56 -07:00 |
|
yinfan98
|
b8b6008f47
|
[Fix] fix fa3 build at cu118 (#5036)
|
2025-04-03 11:52:35 -07:00 |
|
fzyzcjy
|
8e10fec9a8
|
Small refactor DeepEPMode to clean up code a bit (#4992)
|
2025-04-03 02:56:44 -07:00 |
|
Baizhou Zhang
|
e8999b13b7
|
Replace enable_flashinfer_mla argument with attention_backend (#5005)
|
2025-04-03 02:53:58 -07:00 |
|
Xiaoyu Zhang
|
772d2a191d
|
try to fix ci oserror (#5024)
|
2025-04-03 02:45:05 -07:00 |
|
Zhiqiang Xie
|
9d0b36c47a
|
fix deepgemm as well (#5030)
|
2025-04-03 02:41:37 -07:00 |
|
Yuhong Guo
|
7d8c0ce7ce
|
[Build] Support build sgl-kernel with ccache (#5020)
|
2025-04-03 00:22:37 -07:00 |
|
saltyfish66
|
e41549c3d6
|
fix: fix illegal cuda memory access at fused_moe_kernel (#4727)
Co-authored-by: yuethe <yuethe@tencent.com>
|
2025-04-03 00:07:32 -07:00 |
|
renxin
|
cccfc10e9c
|
Feature/revise docs ci (#5009)
|
2025-04-02 20:08:56 -07:00 |
|
Zhiqiang Xie
|
a2aea59b6e
|
update cutlass tag (#5011)
|
2025-04-02 18:30:30 -07:00 |
|
Xiaoyu Zhang
|
2c8fd99363
|
[sgl-kernel] per token group quant support COLUMN MAJOR (#4817)
|
2025-04-02 18:29:59 -07:00 |
|
Kaiyu Yang
|
31da75abed
|
Update tokenizer_manager.py (#5008)
|
2025-04-02 13:56:19 -07:00 |
|
Qingquan Song
|
e983e43248
|
Add Eagle Speculative Decoding to FA3 Backend (#4951)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
|
2025-04-02 13:09:02 -07:00 |
|
Xiaoyu Zhang
|
e9c6ce461d
|
sgl scaled_fp8_quant support output padding (#4861)
|
2025-04-02 23:53:57 +08:00 |
|
Zhiqiang Xie
|
3fadc64793
|
bug fix for hicache host eviction (#4989)
|
2025-04-02 00:33:50 -07:00 |
|
Zhiqiang Xie
|
e119f04215
|
Large page size aligned hierarchical caching (#4581)
|
2025-04-01 22:38:15 -07:00 |
|
XinyuanTong
|
9eb49e878b
|
[VLM RLHF] Take Image input for verl vlm rollout (#4915)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: GeLee <leege233@gmail.com>
|
2025-04-01 20:03:17 -07:00 |
|
Zhiqiang Xie
|
12047f5e94
|
Prevent memory leak of retract_decode when page_size > 1 (#4977)
|
2025-04-01 15:30:45 -07:00 |
|
Yineng Zhang
|
fda6bb78da
|
update bench_serving (#4958)
|
2025-04-01 15:10:56 -07:00 |
|
Jinyan Chen
|
23c764b18a
|
[Feature] Support DeepEP Low Latency (#4767)
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>
|
2025-04-01 09:23:25 -07:00 |
|
Yuhong Guo
|
87fafa0105
|
Revert PR 4764 & 4813 related to R1 RoPE (#4959)
|
2025-03-31 20:56:58 -07:00 |
|
Yineng Zhang
|
1c63e79756
|
use fa3 in sgl-kernel (#4954)
|
2025-03-31 16:14:49 -07:00 |
|
Yuhong Guo
|
ee47a6c1c3
|
[Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953)
|
2025-03-31 12:00:34 -07:00 |
|
Yineng Zhang
|
6384d31776
|
bump sgl-kernel v0.0.6 (#4950)
|
2025-03-31 11:24:09 -07:00 |
|
Mick
|
5cb552b1d4
|
refactor: multimodal data (#4754)
|
2025-03-31 09:57:51 -07:00 |
|
yinfan98
|
c7457191a0
|
[Fix] revert clean m.def for cudagraph (#4944)
|
2025-03-31 02:08:55 -07:00 |
|
JieXin Liang
|
51ac297ace
|
[feat] interface for platforms abstraction (#4928)
|
2025-03-31 00:04:21 -07:00 |
|
Zhiqiang Xie
|
a169b9f813
|
Fix oom error for large page size (#4913)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-03-30 21:34:21 -07:00 |
|
Baizhou Zhang
|
4a63bc32b7
|
[Fix] Add torch compile for torch.clamp back (#4936)
|
2025-03-30 20:46:07 -07:00 |
|
fzyzcjy
|
a303325fdb
|
Fix DeepSeek bug causing 2.2% MMLU drop when TP!=DP (#4883)
Co-authored-by: ch-wan <cwan39@gatech.edu>
|
2025-03-30 20:10:21 -07:00 |
|
Baizhou Zhang
|
42873eac09
|
[Fix] Improve Lora tests and reduce CI runtime (#4925)
|
2025-03-30 19:40:14 -07:00 |
|
Yineng Zhang
|
4814ecaff9
|
cleanup sgl-kernel (#4933)
|
2025-03-30 14:12:30 -07:00 |
|
Baizhou Zhang
|
e62d60fe6d
|
[Fix] avoid stream sync and torch compile in prefill for fa3 backend (#4932)
|
2025-03-30 13:53:44 -07:00 |
|
SEPLOS
|
032f8faaab
|
Fix sglang frontend's incorrect dependency on torch (#4931)
|
2025-03-30 13:00:24 -07:00 |
|
yinfan98
|
37c66ec856
|
[feat] add fa3 in sgl-kernel (#4902)
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
|
2025-03-30 12:57:10 -07:00 |
|
Lianmin Zheng
|
9adf178cc2
|
Fix 2-gpu CI test and suppress some warnings (#4930)
|
2025-03-30 12:51:44 -07:00 |
|
Lianmin Zheng
|
f842853a40
|
Fix the timeout for unit-test-2-gpu in pr-test.yml (#4927)
|
2025-03-30 12:15:40 -07:00 |
|
Yineng Zhang
|
195a09f57c
|
fix bmm fp8 (#4926)
|
2025-03-30 12:15:20 -07:00 |
|
Adarsh Shirawalmath
|
9fccda3111
|
[Feature] use pytest for sgl-kernel (#4896)
|
2025-03-30 10:36:52 -07:00 |
|
Lianmin Zheng
|
4ede6770cd
|
Fix retract for page size > 1 (#4914)
|
2025-03-30 02:57:15 -07:00 |
|
Lianmin Zheng
|
b26bc86b36
|
Support page size > 1 + eagle (#4908)
|
2025-03-30 00:46:23 -07:00 |
|
Yi Zhang
|
5ec5eaf760
|
fix allreduce test (#4909)
|
2025-03-29 23:16:53 -07:00 |
|
yinfan98
|
0d7fe866f9
|
[Misc] Clean m.def and add Development Tips (#4890)
|
2025-03-29 23:06:18 -07:00 |
|
Yineng Zhang
|
54b9a2de0a
|
remove setup for sgl-kernel (#4899)
|
2025-03-29 12:47:38 -07:00 |
|
yinfan98
|
8e7b31546c
|
quick fix: add default for new kernel (#4898)
|
2025-03-29 12:31:59 -07:00 |
|
Qingquan Song
|
45dcfc2e76
|
Add deepseek style fused moe group gate selection kernel (#4530)
|
2025-03-29 11:51:45 -07:00 |
|
yinfan98
|
ddf8981d91
|
Delete test_deep_gemm.py (#4891)
|
2025-03-29 10:46:11 -07:00 |
|
Yineng Zhang
|
400ad66019
|
Update CODEOWNERS (#4889)
|
2025-03-29 09:56:51 -07:00 |
|