Xiaoyu Zhang
|
a167fd0bcb
|
[code style] Clean dead triton kernel code in fused_moe and useless vllm_ops import (#8310)
|
2025-07-24 14:38:30 +08:00 |
|
Simo Lin
|
2f86f3ad62
|
[router] add endpoint unit test (#8298)
|
2025-07-23 23:26:44 -07:00 |
|
Minho Ryu
|
bfb118c01e
|
fix bug when eos_ids==0 (#8315)
|
2025-07-23 23:18:47 -07:00 |
|
Simo Lin
|
f6e07f2796
|
[router] fix pd model completion request (#8303)
|
2025-07-23 23:18:29 -07:00 |
|
Simo Lin
|
5dd0f870ab
|
[bug] fix pd completion protocol for batching support (#8317)
|
2025-07-23 23:18:17 -07:00 |
|
Haohui Mai
|
f7e102d56a
|
Pin the version of petit kernel to fix the APIs (#8235)
|
2025-07-23 17:57:20 -07:00 |
|
michael-amd
|
0e5fa67773
|
[AMD] Pull latest image for AMD CI (#8070)
|
2025-07-23 17:56:14 -07:00 |
|
xianzhiT
|
624a3b8d1f
|
Fix incomplete tool call capture issue in streaming response of DeepSeek-V3 when enable MTP (#7562)
|
2025-07-23 17:40:23 -07:00 |
|
Chang Su
|
01079e174f
|
feat(function call): complete utility method for KimiK2Detector and enhance documentation (#8043)
|
2025-07-23 17:37:31 -07:00 |
|
J
|
0e7a5b2694
|
fix: prevent crashes due to logit bias dimension mismatch (#7685)
|
2025-07-23 15:30:55 -07:00 |
|
Yineng Zhang
|
4953f4ca9a
|
chore: upgrade sgl-kernel 0.2.7 (#8304)
|
2025-07-23 15:07:27 -07:00 |
|
Xinyuan Tong
|
38000a5f44
|
Fix gemma3n with hybrid swa (#8240)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-23 13:29:18 -07:00 |
|
Xinyuan Tong
|
70251e935e
|
fix: match chat-template for internvl3 (#8262)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-23 13:29:03 -07:00 |
|
xianzhiT
|
c87d4fec99
|
Fix the issue of incorrect finish reason in final stream response chunk returned during tool call (#7708)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-07-23 13:28:53 -07:00 |
|
YiXR
|
a99801e075
|
[Performance][PD Disaggregation] optimize TokenToKVPoolAllocator by sorting free pages (#8133)
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
Co-authored-by: Xingrui Yi <yixingrui@linux.alibaba.com>
|
2025-07-23 13:28:12 -07:00 |
|
Yineng Zhang
|
4c605235aa
|
fix: workaround for deepgemm warmup issue (#8302)
|
2025-07-23 12:01:51 -07:00 |
|
Simo Lin
|
6f8f4aeea4
|
[router] add common ut infra to mock worker and app (#8295)
|
2025-07-23 10:07:51 -07:00 |
|
Yuan Luo
|
0c8dab9e67
|
[sgl-kernel] Opt per_token_quant_fp8 with warp reduce (#8130)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-07-23 21:22:59 +08:00 |
|
Zhiqiang Xie
|
f39037fffb
|
HiCache Fix (#8288)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
|
2025-07-23 16:51:32 +08:00 |
|
Zhiqiang Xie
|
ce86e201df
|
bug fix and tag (#8282)
|
2025-07-23 16:50:31 +08:00 |
|
Zhiqiang Xie
|
b43263307f
|
Hicache IO kernel refactoring (#8264)
|
2025-07-23 16:49:03 +08:00 |
|
Lifu Huang
|
8abd3e77fe
|
Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261)
|
2025-07-23 00:32:16 -07:00 |
|
Ke Bao
|
e885bfdc6a
|
Fix sgl-kernel ci test (#8284)
|
2025-07-23 14:01:47 +08:00 |
|
Ke Bao
|
e2d66f60c8
|
Skip llama4 vision module loading when multimodal disabled (#8272)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-07-23 12:41:25 +08:00 |
|
Yineng Zhang
|
01c000043c
|
chore: bump v0.4.9.post3 (#8265)
|
2025-07-22 15:55:48 -07:00 |
|
yhyang201
|
0dfe2491ac
|
Preliminary Support for Qwen3XMLDetector (#8260)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2025-07-23 06:49:38 +08:00 |
|
zhongwei
|
ff45ab7a5f
|
[Benchmark] add disable-auto-run param for hicache/bench_multiturn (#7822)
Co-authored-by: zhongwei.ren <zhongwei.ren@bytedance.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-22 14:02:40 -07:00 |
|
Peter Pan
|
0f8b538614
|
[fix] benchmark : routed_scaling_factor is None (#8059)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-07-22 08:55:35 -07:00 |
|
Rui Chen
|
c33499a67b
|
fix: sgl-router remove dead code (#8257)
|
2025-07-22 08:41:23 -07:00 |
|
Hubert Lu
|
e50109f2ed
|
[AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 (#7484)
|
2025-07-21 17:33:19 -07:00 |
|
Xinyuan Tong
|
69adc4f81c
|
fix: retrieve mm token by modality, raise error if none (#8221)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-22 08:06:35 +08:00 |
|
Yineng Zhang
|
114837854f
|
docs: update 2025 h2 roadmap (#8237)
|
2025-07-21 14:02:48 -07:00 |
|
Xiaoze Fan
|
7b68d27111
|
[Feature] Add a test for Layer-wise Prefill (#8231)
Signed-off-by: jason-fxz <jason341132@qq.com>
|
2025-07-21 22:06:15 +08:00 |
|
Yineng Zhang
|
74f59ae555
|
chore: upgrade sgl-kernel 0.2.6.post1 (#8202)
|
2025-07-21 02:10:24 -07:00 |
|
Ke Bao
|
6936be3221
|
Remve router gemm output dtype conversion (#8204)
|
2025-07-21 15:37:00 +08:00 |
|
Simo Lin
|
9b5de6cb06
|
[router] upgade router version to 0.1.6 (#8209)
|
2025-07-20 23:13:20 -07:00 |
|
Simo Lin
|
5c8365a051
|
[router] add ut for pd router (#8208)
|
2025-07-20 23:12:52 -07:00 |
|
Xinyuan Tong
|
8430bfe3e9
|
[Refactor] simplify multimodal data processing (#8107)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-20 21:43:09 -07:00 |
|
Ke Bao
|
c9e8613c97
|
Apply fused sorted token ids padding (#8193)
|
2025-07-21 11:19:48 +08:00 |
|
Yineng Zhang
|
429bb0efa2
|
chore: bump sgl-kernel v0.2.6.post1 (#8200)
|
2025-07-20 19:50:28 -07:00 |
|
JieXin Liang
|
7eebd44047
|
[fix] fix modelopt fp4 on b200 (#8195)
|
2025-07-20 17:39:57 -07:00 |
|
ronnie_zheng
|
93d124ef5a
|
[feature] enable NPU CI (#7935)
Co-authored-by: Even Zhou <14368888+iforgetmyname@users.noreply.github.com>
|
2025-07-20 13:12:42 -07:00 |
|
Simo Lin
|
1fc455e8b6
|
[router] add ut for pd request, metrics and config (#8184)
|
2025-07-20 10:53:42 -07:00 |
|
Ke Bao
|
465968b2e3
|
Fix dtype error in CI (#8197)
|
2025-07-21 00:27:55 +08:00 |
|
GuoYipin
|
750838adc4
|
fix: fix the bug of loading Internvl3 (#8067)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-20 22:22:54 +08:00 |
|
Jay Zhou
|
99aefa037e
|
Fix eagle3 cuda graph (#8163)
|
2025-07-20 15:28:06 +08:00 |
|
Qiaolin Yu
|
bbcfbc1a02
|
feat: add h200 tp 16 kimi k2 moe config (#8183)
|
2025-07-19 23:30:08 -07:00 |
|
Praneth Paruchuri
|
83c104b188
|
Feat: Support for Persimmon Model (#7983)
|
2025-07-19 23:07:47 -07:00 |
|
Yineng Zhang
|
2db6719cc5
|
feat: update nccl 2.27.6 (#8182)
|
2025-07-19 22:55:45 -07:00 |
|
Lianmin Zheng
|
55381a46ac
|
Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181)
|
2025-07-19 22:41:30 -07:00 |
|