Commit Graph

3197 Commits

Author SHA1 Message Date
Chang Su
1940cdec61 [Bugfix] Fix Llama4 gibberish output with long context and CUDA graph (#6162) 2025-05-09 15:33:02 -07:00
thyecust
63484f9fd6 feat: add thinking_budget (#6089) 2025-05-09 08:22:09 -07:00
Sai Enduri
dff0ab92eb Update amd nightly concurrency. (#6141) 2025-05-09 00:02:14 -07:00
xu-yfei
e30c273bc9 opt flashinfer mla cat (#5822)
Co-authored-by: xuyongfei.xyf <xuyongfei.xyf@antgroup.com>
2025-05-08 23:17:14 -07:00
Trevor Morris
0ab3f437ab Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101) 2025-05-08 18:44:30 -07:00
yhyang201
cec98f1034 [Fix] Incorrect Memory Allocation on CUDA:0 by Non-Zero CUDA Processes in TP/DP (#5745) 2025-05-08 17:52:26 -07:00
Yineng Zhang
8dc4efd0ab docs: update README (#6132) 2025-05-08 15:18:48 -07:00
Yineng Zhang
6578cf27de chore: bump sgl-kernel 0.1.2 (#6131) 2025-05-08 15:16:28 -07:00
Stefan He
087751a8f2 Remove unecessary is_fa3_supported check (#6112) 2025-05-08 14:45:33 -07:00
Yixin Dong
911f3ba6f4 upgrade xgrammar to 0.1.19 (#6129) 2025-05-08 14:42:02 -07:00
PGFLMG
f6f96b0521 [sgl-kernel] fix: fix cu118 compile error (#6123)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-05-08 14:26:51 -07:00
Hubert Lu
2a936a841e [AMD] switch to custom allreduce regardless of MSCCL setting on ROCm (#6097) 2025-05-08 13:46:58 -07:00
JieXin Liang
5e02330137 [perf] dsv3 bmm fallback to bf16 (#5662) 2025-05-08 11:43:39 -07:00
Zhu Chen
fa7d7fd9e5 [Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
2025-05-08 10:01:19 -07:00
JieXin Liang
f1ff736d68 [fix] fix pyproject.toml dependencies (#6119) 2025-05-08 02:14:36 -07:00
lukec
acc816d8a2 DeepEP normal support deepgemm-contiguous (#5626)
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>
Co-authored-by: ZhengHSI <zhenghsi@qq.com>
2025-05-08 01:20:32 -07:00
fzyzcjy
a05bd83a94 Change AMD test threshold (#6091) 2025-05-08 01:05:52 -07:00
fzyzcjy
cef91b1ed7 [PD] Add control to slow down a server (#5572) 2025-05-08 01:03:08 -07:00
fzyzcjy
6450c1228c Tiny refactor weight loading logic (#5232) 2025-05-08 01:02:56 -07:00
fzyzcjy
b6cf3532b5 Tiny refactor ModelConfig.from_server_args (#5219) 2025-05-08 01:02:43 -07:00
fzyzcjy
3b2680a44d Overlap shared expert and routed expert computations (#5121) 2025-05-08 01:02:32 -07:00
Minglei Zhu
79961afa82 optimize pad operations in fa3 to accelarate 100+us (#6077) 2025-05-07 23:40:08 -07:00
Baizhou Zhang
cfca4e0ed2 adding Triton configs for DeepSeekV3 FusedMoE kernel on Blackwell (#6111) 2025-05-07 23:39:10 -07:00
XinyuanTong
e88dd482ed [CI]Add performance CI for VLM (#6038)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
2025-05-07 19:20:03 -07:00
Baizhou Zhang
73600673bb Clean logs for DeepSeek-V3 launching (#6079) 2025-05-07 18:54:50 -07:00
Baizhou Zhang
8f508cc77f Update doc for MLA attention backends (#6034) 2025-05-07 18:51:05 -07:00
Cheng Wan
9bddf1c82d Deferring 8 GPU test (#6102) 2025-05-07 18:49:58 -07:00
Stefan He
24c13ca950 Clean up fa3 test from 8 gpus (#6105) 2025-05-07 18:38:40 -07:00
JieXin Liang
b70957fcf8 [refactor] slightly tidy fp8 module (#5993) 2025-05-07 17:28:24 -07:00
ishandhanani
e444c13fb4 feat(engine): add bootstrap parameters to generate methods (dynamo) (#6075) 2025-05-07 10:33:58 -07:00
Baizhou Zhang
fee37d9e8d [Doc]Fix description for dp_size argument (#6063) 2025-05-08 00:04:22 +08:00
fzyzcjy
c68de47915 Super tiny fix doc (#5233) 2025-05-07 22:41:50 +08:00
fzyzcjy
4c7b42424c Hint users DeepEP normal mode is incompatible with CUDA Graph (#5014) 2025-05-07 22:40:59 +08:00
Lianmin Zheng
38053c3372 Fix the timeout for 8 gpu tests (#6084) 2025-05-07 03:13:12 -07:00
Song Zhang
00c2c1f08b [Feature] Support for Ascend NPU backend (#3853)
Signed-off-by: Song Zhang <gepin.zs@antgroup.com>
Co-authored-by: 22dimensions <waitingwind@foxmail.com>
2025-05-06 20:32:53 -07:00
Johnny
cb69194562 feat: add release workflow for SGLang kernels on aarch64 (#6010)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-05-06 19:42:07 -07:00
Xiaoyu Zhang
d25398cbc8 fix custom_allreduce namespace (#6039) 2025-05-06 19:13:06 -07:00
Jinyan Chen
8a828666a3 Add DeepEP to CI PR Test (#5655)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
2025-05-06 17:36:03 -07:00
Qiaolin Yu
aff584fa54 Fix sgl-kernel build on aarch64 platforms (#6062) 2025-05-06 16:10:57 -07:00
Yineng Zhang
6f56614734 chore: upgrade cutlass 3.9.2 (#6004)
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-05-06 13:34:08 -07:00
Baizhou Zhang
bdd17998e6 [Fix] Fix and rename flashmla CI test (#6045) 2025-05-06 13:25:15 -07:00
Hank Han
c9abd7be01 fix: deepep dockerfile, use pip install deepep. (#5885) 2025-05-06 10:55:26 -07:00
Liangsheng Yin
a3e4e9bf9e Better PD initialization (#5751) 2025-05-07 01:12:57 +08:00
Liangsheng Yin
6d4d3bc81d Fix not "import os" (#6057) 2025-05-06 22:06:41 +08:00
Yineng Zhang
5f300141b7 docs: add new blog (#6048) 2025-05-06 00:48:10 -07:00
Yineng Zhang
1c05425bcb docs: add Google Cloud Vertex AI in Adoption and Sponsorship (#6047) 2025-05-06 00:31:48 -07:00
Zhiqiang Xie
b26cb1c55a Fix problem of large page size with chunked prefill (#6046) 2025-05-06 15:19:47 +08:00
Zhiqiang Xie
f8e460930a Fix prefill OOM error in the case of large page size (#5081) 2025-05-05 16:02:55 -07:00
Adarsh Shirawalmath
683707c314 [Security][Bug] Prevent binding to all TCP interfaces (#5752) 2025-05-06 03:21:45 +08:00
mlmz
a68ed76682 feat: append more comprehensive fields in messages instead of merely role and content (#5996) 2025-05-05 11:43:34 -07:00