Yusong Gao
|
41273fd71f
|
fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)
|
2025-05-11 00:28:21 -07:00 |
|
JieXin Liang
|
e9bebafb19
|
[fix] remove mixtral from is_fa3_default_architecture (#6191)
|
2025-05-11 00:15:54 -07:00 |
|
Yineng Zhang
|
4d1c9db66c
|
feat: support loogle eval (#6190)
|
2025-05-10 23:52:44 -07:00 |
|
Lianmin Zheng
|
17c36c5511
|
[CI] Disabled deepep tests temporarily because it takes too much time. (#6186)
|
2025-05-10 23:40:50 -07:00 |
|
shangmingc
|
31d1f6e7f4
|
[PD] Add simple unit test for disaggregation feature (#5654)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
|
2025-05-11 13:35:27 +08:00 |
|
Emmanuel Ferdman
|
a823c6e834
|
Remove duplicate IO Struct test (#6180)
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
|
2025-05-11 12:57:26 +08:00 |
|
applesaucethebun
|
2ce8793519
|
Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-05-11 12:55:00 +08:00 |
|
Lianmin Zheng
|
de167cf5fa
|
Fix request abortion (#6184)
|
2025-05-10 21:54:46 -07:00 |
|
Lianmin Zheng
|
4319978c73
|
Fix data parallel perf regression (#6183)
|
2025-05-10 19:18:35 -07:00 |
|
Steven Shimizu
|
03dd785cd0
|
Added async_encode method to Engine (#4701)
|
2025-05-10 18:58:40 -07:00 |
|
Yineng Zhang
|
66fc63d6b1
|
Revert "feat: add thinking_budget (#6089)" (#6181)
|
2025-05-10 16:07:45 -07:00 |
|
Ximingwang-09
|
921e4a8185
|
[Docs]Delete duplicate content (#6146)
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
|
2025-05-10 15:02:15 -07:00 |
|
XinyuanTong
|
9d8ec2e67e
|
Fix and Clean up chat-template requirement for VLM (#6114)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-11 00:14:09 +08:00 |
|
JieXin Liang
|
c178abdabc
|
[fix] fix determine_n_share_experts_fusion (#6118)
|
2025-05-10 01:19:09 -07:00 |
|
Simon (Jiyou) Li
|
b29a026e14
|
KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to MHATokenToKVPoolHost and MLATokenToKVPoolHost (#6016)
Co-authored-by: 继优 <jiyou.ljy@alibaba-inc.com>
Co-authored-by: chus-chus <chus-chus@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-05-09 15:50:06 -07:00 |
|
Yineng Zhang
|
678d8cc987
|
chore: bump v0.4.6.post3 (#6165)
|
2025-05-09 15:38:47 -07:00 |
|
huangtingwei
|
d2cb3024f2
|
fix bug that gpu0 occupies more memory when hicache is turned on (#5778)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-05-09 15:36:08 -07:00 |
|
Chang Su
|
1940cdec61
|
[Bugfix] Fix Llama4 gibberish output with long context and CUDA graph (#6162)
|
2025-05-09 15:33:02 -07:00 |
|
thyecust
|
63484f9fd6
|
feat: add thinking_budget (#6089)
|
2025-05-09 08:22:09 -07:00 |
|
Sai Enduri
|
dff0ab92eb
|
Update amd nightly concurrency. (#6141)
|
2025-05-09 00:02:14 -07:00 |
|
xu-yfei
|
e30c273bc9
|
opt flashinfer mla cat (#5822)
Co-authored-by: xuyongfei.xyf <xuyongfei.xyf@antgroup.com>
|
2025-05-08 23:17:14 -07:00 |
|
Trevor Morris
|
0ab3f437ab
|
Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101)
|
2025-05-08 18:44:30 -07:00 |
|
yhyang201
|
cec98f1034
|
[Fix] Incorrect Memory Allocation on CUDA:0 by Non-Zero CUDA Processes in TP/DP (#5745)
|
2025-05-08 17:52:26 -07:00 |
|
Yineng Zhang
|
8dc4efd0ab
|
docs: update README (#6132)
|
2025-05-08 15:18:48 -07:00 |
|
Yineng Zhang
|
6578cf27de
|
chore: bump sgl-kernel 0.1.2 (#6131)
|
2025-05-08 15:16:28 -07:00 |
|
Stefan He
|
087751a8f2
|
Remove unecessary is_fa3_supported check (#6112)
|
2025-05-08 14:45:33 -07:00 |
|
Yixin Dong
|
911f3ba6f4
|
upgrade xgrammar to 0.1.19 (#6129)
|
2025-05-08 14:42:02 -07:00 |
|
PGFLMG
|
f6f96b0521
|
[sgl-kernel] fix: fix cu118 compile error (#6123)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-05-08 14:26:51 -07:00 |
|
Hubert Lu
|
2a936a841e
|
[AMD] switch to custom allreduce regardless of MSCCL setting on ROCm (#6097)
|
2025-05-08 13:46:58 -07:00 |
|
JieXin Liang
|
5e02330137
|
[perf] dsv3 bmm fallback to bf16 (#5662)
|
2025-05-08 11:43:39 -07:00 |
|
Zhu Chen
|
fa7d7fd9e5
|
[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
|
2025-05-08 10:01:19 -07:00 |
|
JieXin Liang
|
f1ff736d68
|
[fix] fix pyproject.toml dependencies (#6119)
|
2025-05-08 02:14:36 -07:00 |
|
lukec
|
acc816d8a2
|
DeepEP normal support deepgemm-contiguous (#5626)
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>
Co-authored-by: ZhengHSI <zhenghsi@qq.com>
|
2025-05-08 01:20:32 -07:00 |
|
fzyzcjy
|
a05bd83a94
|
Change AMD test threshold (#6091)
|
2025-05-08 01:05:52 -07:00 |
|
fzyzcjy
|
cef91b1ed7
|
[PD] Add control to slow down a server (#5572)
|
2025-05-08 01:03:08 -07:00 |
|
fzyzcjy
|
6450c1228c
|
Tiny refactor weight loading logic (#5232)
|
2025-05-08 01:02:56 -07:00 |
|
fzyzcjy
|
b6cf3532b5
|
Tiny refactor ModelConfig.from_server_args (#5219)
|
2025-05-08 01:02:43 -07:00 |
|
fzyzcjy
|
3b2680a44d
|
Overlap shared expert and routed expert computations (#5121)
|
2025-05-08 01:02:32 -07:00 |
|
Minglei Zhu
|
79961afa82
|
optimize pad operations in fa3 to accelarate 100+us (#6077)
|
2025-05-07 23:40:08 -07:00 |
|
Baizhou Zhang
|
cfca4e0ed2
|
adding Triton configs for DeepSeekV3 FusedMoE kernel on Blackwell (#6111)
|
2025-05-07 23:39:10 -07:00 |
|
XinyuanTong
|
e88dd482ed
|
[CI]Add performance CI for VLM (#6038)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-07 19:20:03 -07:00 |
|
Baizhou Zhang
|
73600673bb
|
Clean logs for DeepSeek-V3 launching (#6079)
|
2025-05-07 18:54:50 -07:00 |
|
Baizhou Zhang
|
8f508cc77f
|
Update doc for MLA attention backends (#6034)
|
2025-05-07 18:51:05 -07:00 |
|
Cheng Wan
|
9bddf1c82d
|
Deferring 8 GPU test (#6102)
|
2025-05-07 18:49:58 -07:00 |
|
Stefan He
|
24c13ca950
|
Clean up fa3 test from 8 gpus (#6105)
|
2025-05-07 18:38:40 -07:00 |
|
JieXin Liang
|
b70957fcf8
|
[refactor] slightly tidy fp8 module (#5993)
|
2025-05-07 17:28:24 -07:00 |
|
ishandhanani
|
e444c13fb4
|
feat(engine): add bootstrap parameters to generate methods (dynamo) (#6075)
|
2025-05-07 10:33:58 -07:00 |
|
Baizhou Zhang
|
fee37d9e8d
|
[Doc]Fix description for dp_size argument (#6063)
|
2025-05-08 00:04:22 +08:00 |
|
fzyzcjy
|
c68de47915
|
Super tiny fix doc (#5233)
|
2025-05-07 22:41:50 +08:00 |
|
fzyzcjy
|
4c7b42424c
|
Hint users DeepEP normal mode is incompatible with CUDA Graph (#5014)
|
2025-05-07 22:40:59 +08:00 |
|