Commit Graph

1996 Commits

Author SHA1 Message Date
Ke Bao
c3948ba67e Reorder loop in shared expert weight loading (#5719) 2025-04-25 17:27:42 -07:00
Xiaoyu Zhang
18ce468d56 update triton 3.2.0 h200 fused moe triton config and add warning about triton fused_moe_kernel performance degradation due to different Triton versions. (#5740) 2025-04-25 16:24:59 -07:00
Lianmin Zheng
21514ff5bd Disable flaky eagle tests (#5753) 2025-04-25 15:54:39 -07:00
Lianmin Zheng
5641a09458 Revert "[Model] Support ArcticForCausalLM architecture (Snowflake/snowflake-arctic-instruct)" (#5754) 2025-04-25 15:50:28 -07:00
michael-amd
93c6fb12c7 Fix: deepseek forward absorb (#5723)
Co-authored-by: ispobock <ispobaoke@163.com>
2025-04-25 13:48:55 -07:00
IAN
11e27d0926 [PD]: Support Muti Prefill in one node (#5704)
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
2025-04-26 00:30:47 +08:00
shangmingc
50eda8398e [PD] Add kvargs table and thread pool for kvcache sender of mooncake (#5738)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-04-25 18:15:01 +08:00
Liangsheng Yin
c55550cbf0 [PD] Better logs (#5715) 2025-04-25 17:25:45 +08:00
Brayden Zhong
43fb95c2fa [Model] Support ArcticForCausalLM architecture (Snowflake/snowflake-arctic-instruct) (#5078)
Co-authored-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
2025-04-25 15:24:09 +08:00
Baizhou Zhang
a14654dd68 Fix weight loading bug for Deepseek v3+nextn (#5684) 2025-04-24 21:29:56 +08:00
Yuhong Guo
5d93a950ee [BugFix] Fix combination of MTP and --n-share-experts-fusionwith R1 (#5707) 2025-04-24 21:13:51 +08:00
Mick
c998d04b46 vlm: enable radix cache for qwen-vl models (#5349)
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
2025-04-23 20:35:05 -07:00
Yineng Zhang
b1f6d89b5f fix: update truss bench_serving (#5683) 2025-04-23 13:28:35 -07:00
shangmingc
e0673969b9 [PD] Add support for dp attention with mooncake (#5530)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-04-23 17:20:27 +08:00
Cheng Wan
711efe7814 Integrating PD disaggregation with DP attention and DeepEP (#5435)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-04-23 01:46:01 -07:00
Yineng Zhang
fbb5f229d4 fix awq_dequantize import (#5669) 2025-04-23 01:36:26 -07:00
fzyzcjy
71d1785f2d Remove unnecessary torch.full in DeepSeek (#5601) 2025-04-22 21:24:29 -07:00
Baizhou Zhang
3f87f83116 Fuse q_a_proj and kv_a_proj (#5619) 2025-04-22 20:35:08 -07:00
Baizhou Zhang
ce5412b62e Turn on DeepGemm By Default and Update Doc (#5628) 2025-04-22 16:10:08 -07:00
Yineng Zhang
7282ab741a fix: update bench_speculative (#5649) 2025-04-22 16:08:15 -07:00
HAI
b0feda090c Revert "Support aiter RMSNorm in AMD" (#5646) 2025-04-22 15:20:24 -07:00
Ke Bao
6b6e748775 Remove q concat in FA3 backend for DeepSeek decode (#5638) 2025-04-22 11:43:12 -07:00
JieXin Liang
917324862e [fix] reduce dp capture bs (#5634)
Co-authored-by: alcanerian <alcanerian@gmail.com>
2025-04-22 11:08:45 -07:00
lukec
2ed96c7a8a fix flashmla bug (#5272) 2025-04-22 10:36:23 -07:00
saltyfish66
2aa3f5e2d0 [feature] Add H20 fp8_w8a8 FusedMoE config for --n-share-experts-fusion=16 (#5641)
Co-authored-by: yuethe <yuethe@tencent.com>
2025-04-22 09:33:13 -07:00
lambert0312
76d17c7ecb Fix shared experts fusion error without quantization (#5632) 2025-04-22 09:22:26 -07:00
Connector Switch
70d040f904 [NFC] Remove duplicate compressed-tensors (#5640) 2025-04-22 09:10:25 -07:00
JieXin Liang
4418f599a5 Fix FA3 DeepSeek prefill performance regression (#5624)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2025-04-22 01:41:41 -07:00
Yineng Zhang
04f2abcb34 fix: gemma 3 not use softcap (#5622) 2025-04-22 01:16:08 -07:00
JieXin Liang
506be6b892 [fix] fix compile_deep_gemm missing kv_b_proj (#5620) 2025-04-22 00:06:36 -07:00
JieXin Liang
2343d8df7d [fix] force use deepgemm in compile_deep_gemm (#5618) 2025-04-21 21:36:02 -07:00
Ke Bao
11b23ae97b Remove extra copy in deepseek forward absorb (#5578)
Co-authored-by: saienduri <saimanas.enduri@amd.com>
2025-04-21 19:33:21 -07:00
Yineng Zhang
b9c87e781d chore: bump v0.4.5.post3 (#5611) 2025-04-21 18:16:20 -07:00
michael-amd
968ef51562 Support aiter RMSNorm in AMD (#5510)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
2025-04-21 17:40:39 -07:00
Lianmin Zheng
1343200299 Clean up mem settings (#5610) 2025-04-21 17:19:00 -07:00
JieXin Liang
c2942907d5 [feature] enable pre compile jit deep_gemm (#5580) 2025-04-21 16:52:53 -07:00
Liangsheng Yin
e69a219074 Enhance GPU memory settings (#5604) 2025-04-21 15:15:00 -07:00
Byron Hsu
bf98d2e377 [PD] Support prefill overlap + Ensure no race condition (#5609) 2025-04-21 12:12:56 -07:00
Byron Hsu
e65b9f21e3 [PD] Support decode overlap schedule (#5608) 2025-04-21 12:06:16 -07:00
Trevor Morris
4dce1cc608 [PD] Add NIXL transfer backend (#5477) 2025-04-22 01:36:12 +08:00
Byron Hsu
deded17f38 [PD] Fix edge case and simplify large page size + chunked prefill (#5589) 2025-04-21 10:27:02 -07:00
shangmingc
f29a718f63 [PD] Fix generate endpoint of min_lb for PD (#5598)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-04-21 21:39:18 +08:00
Yongtong Wu
3f57b00a59 Support PD bootstrap fields on /v1/chat/completions endpoint (#5488) 2025-04-21 01:10:58 -07:00
fzyzcjy
453d412cdb Tiny update error hint (#5037) 2025-04-21 00:47:47 -07:00
fzyzcjy
dc86f25a57 Tiny remove duplicated code (#5021) 2025-04-21 00:47:32 -07:00
Chuyue Sun
08289eaa3e Support o1 model on Azure (#4980)
Co-authored-by: Shan Yu <shanyu1@g.ucla.edu>
2025-04-21 00:46:09 -07:00
Lucius
3b6d539f63 [Fix] Enhance DP Attention for IPv6 Compatibility (#4937) 2025-04-21 00:44:11 -07:00
lambert0312
c44f2869c9 Modify metrics service endpoint (#3443) 2025-04-21 00:35:38 -07:00
fzyzcjy
685d8980c3 Tiny add warning when cannot recognize bool env var (#5348) 2025-04-20 23:11:29 -07:00
Zhiqiang Xie
70645f4d7d upstream hicache fixes (#5570) 2025-04-20 23:08:30 -07:00