JieXin Liang
|
f1ff736d68
|
[fix] fix pyproject.toml dependencies (#6119)
|
2025-05-08 02:14:36 -07:00 |
|
lukec
|
acc816d8a2
|
DeepEP normal support deepgemm-contiguous (#5626)
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>
Co-authored-by: ZhengHSI <zhenghsi@qq.com>
|
2025-05-08 01:20:32 -07:00 |
|
fzyzcjy
|
a05bd83a94
|
Change AMD test threshold (#6091)
|
2025-05-08 01:05:52 -07:00 |
|
fzyzcjy
|
cef91b1ed7
|
[PD] Add control to slow down a server (#5572)
|
2025-05-08 01:03:08 -07:00 |
|
fzyzcjy
|
6450c1228c
|
Tiny refactor weight loading logic (#5232)
|
2025-05-08 01:02:56 -07:00 |
|
fzyzcjy
|
b6cf3532b5
|
Tiny refactor ModelConfig.from_server_args (#5219)
|
2025-05-08 01:02:43 -07:00 |
|
fzyzcjy
|
3b2680a44d
|
Overlap shared expert and routed expert computations (#5121)
|
2025-05-08 01:02:32 -07:00 |
|
Minglei Zhu
|
79961afa82
|
optimize pad operations in fa3 to accelarate 100+us (#6077)
|
2025-05-07 23:40:08 -07:00 |
|
Baizhou Zhang
|
cfca4e0ed2
|
adding Triton configs for DeepSeekV3 FusedMoE kernel on Blackwell (#6111)
|
2025-05-07 23:39:10 -07:00 |
|
XinyuanTong
|
e88dd482ed
|
[CI]Add performance CI for VLM (#6038)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-07 19:20:03 -07:00 |
|
Baizhou Zhang
|
73600673bb
|
Clean logs for DeepSeek-V3 launching (#6079)
|
2025-05-07 18:54:50 -07:00 |
|
Baizhou Zhang
|
8f508cc77f
|
Update doc for MLA attention backends (#6034)
|
2025-05-07 18:51:05 -07:00 |
|
Cheng Wan
|
9bddf1c82d
|
Deferring 8 GPU test (#6102)
|
2025-05-07 18:49:58 -07:00 |
|
Stefan He
|
24c13ca950
|
Clean up fa3 test from 8 gpus (#6105)
|
2025-05-07 18:38:40 -07:00 |
|
JieXin Liang
|
b70957fcf8
|
[refactor] slightly tidy fp8 module (#5993)
|
2025-05-07 17:28:24 -07:00 |
|
ishandhanani
|
e444c13fb4
|
feat(engine): add bootstrap parameters to generate methods (dynamo) (#6075)
|
2025-05-07 10:33:58 -07:00 |
|
Baizhou Zhang
|
fee37d9e8d
|
[Doc]Fix description for dp_size argument (#6063)
|
2025-05-08 00:04:22 +08:00 |
|
fzyzcjy
|
c68de47915
|
Super tiny fix doc (#5233)
|
2025-05-07 22:41:50 +08:00 |
|
fzyzcjy
|
4c7b42424c
|
Hint users DeepEP normal mode is incompatible with CUDA Graph (#5014)
|
2025-05-07 22:40:59 +08:00 |
|
Lianmin Zheng
|
38053c3372
|
Fix the timeout for 8 gpu tests (#6084)
|
2025-05-07 03:13:12 -07:00 |
|
Song Zhang
|
00c2c1f08b
|
[Feature] Support for Ascend NPU backend (#3853)
Signed-off-by: Song Zhang <gepin.zs@antgroup.com>
Co-authored-by: 22dimensions <waitingwind@foxmail.com>
|
2025-05-06 20:32:53 -07:00 |
|
Johnny
|
cb69194562
|
feat: add release workflow for SGLang kernels on aarch64 (#6010)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-05-06 19:42:07 -07:00 |
|
Xiaoyu Zhang
|
d25398cbc8
|
fix custom_allreduce namespace (#6039)
|
2025-05-06 19:13:06 -07:00 |
|
Jinyan Chen
|
8a828666a3
|
Add DeepEP to CI PR Test (#5655)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
|
2025-05-06 17:36:03 -07:00 |
|
Qiaolin Yu
|
aff584fa54
|
Fix sgl-kernel build on aarch64 platforms (#6062)
|
2025-05-06 16:10:57 -07:00 |
|
Yineng Zhang
|
6f56614734
|
chore: upgrade cutlass 3.9.2 (#6004)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-05-06 13:34:08 -07:00 |
|
Baizhou Zhang
|
bdd17998e6
|
[Fix] Fix and rename flashmla CI test (#6045)
|
2025-05-06 13:25:15 -07:00 |
|
Hank Han
|
c9abd7be01
|
fix: deepep dockerfile, use pip install deepep. (#5885)
|
2025-05-06 10:55:26 -07:00 |
|
Liangsheng Yin
|
a3e4e9bf9e
|
Better PD initialization (#5751)
|
2025-05-07 01:12:57 +08:00 |
|
Liangsheng Yin
|
6d4d3bc81d
|
Fix not "import os" (#6057)
|
2025-05-06 22:06:41 +08:00 |
|
Yineng Zhang
|
5f300141b7
|
docs: add new blog (#6048)
|
2025-05-06 00:48:10 -07:00 |
|
Yineng Zhang
|
1c05425bcb
|
docs: add Google Cloud Vertex AI in Adoption and Sponsorship (#6047)
|
2025-05-06 00:31:48 -07:00 |
|
Zhiqiang Xie
|
b26cb1c55a
|
Fix problem of large page size with chunked prefill (#6046)
|
2025-05-06 15:19:47 +08:00 |
|
Zhiqiang Xie
|
f8e460930a
|
Fix prefill OOM error in the case of large page size (#5081)
|
2025-05-05 16:02:55 -07:00 |
|
Adarsh Shirawalmath
|
683707c314
|
[Security][Bug] Prevent binding to all TCP interfaces (#5752)
|
2025-05-06 03:21:45 +08:00 |
|
mlmz
|
a68ed76682
|
feat: append more comprehensive fields in messages instead of merely role and content (#5996)
|
2025-05-05 11:43:34 -07:00 |
|
DefTruth
|
82653f6622
|
feat: Add a unified merge_state API (#5428)
|
2025-05-05 10:32:33 -07:00 |
|
Wenxuan Tan
|
22da3d978f
|
Fix "Avoid computing lse in Ragged Prefill when there's no prefix match" (#5555)
|
2025-05-05 10:32:17 -07:00 |
|
Huapeng Zhou
|
b8559764f6
|
[Test] Add flashmla attention backend test (#5587)
|
2025-05-05 10:32:02 -07:00 |
|
shangmingc
|
56f6589ecb
|
[PD] Optimize disaggregation ib device help info (#5781)
|
2025-05-05 13:47:37 +08:00 |
|
Lifu Huang
|
1232f7e8b7
|
Update dev container config to support live code sync and improve docker setup guide (#6018)
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
|
2025-05-04 22:33:46 -07:00 |
|
fzyzcjy
|
3008db9c1a
|
[PD] Allow customizing reserved tokens to avoid KV cache waste (#6002)
|
2025-05-05 11:23:15 +08:00 |
|
Junrong Lin
|
357fb2dba5
|
fix: fix broadcast_pyobj breaking VerlEngine (#5997)
|
2025-05-04 13:15:53 -07:00 |
|
vzed
|
95c231e50d
|
Tool Call: Add chat_template_kwargs documentation (#5679)
|
2025-05-04 13:12:40 -07:00 |
|
Qiaolin Yu
|
3042f1da61
|
Fix flaky issues of lora and add multi batch tests (#5957)
|
2025-05-04 13:11:40 -07:00 |
|
Lifu Huang
|
2b63798c7d
|
[Minor] Fix duplicate method definitions in conversation.py (#6012)
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
|
2025-05-04 13:02:53 -07:00 |
|
Baizhou Zhang
|
bf203cb7a2
|
[Fix] Suppress dynamo logging when using flashinfer backend with torch compile (#5992)
|
2025-05-04 09:49:13 -07:00 |
|
JieXin Liang
|
8ebde73f7d
|
[perf] H100 DeepSeek-V3 fused moe tuned config (#5998)
|
2025-05-03 14:02:26 -07:00 |
|
Stefan He
|
6b0fae797a
|
Fix Phi3 serving which was broke by earlier change (#5991)
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
|
2025-05-03 00:28:47 -07:00 |
|
Yineng Zhang
|
141a459644
|
fix: only upgrade nccl for cu128 (#5986)
|
2025-05-02 11:31:29 -07:00 |
|