ybyang
|
dbb16bedd5
|
Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416)
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
|
2025-10-21 16:27:56 +08:00 |
|
Hank Han
|
c1e1600373
|
[fix] fix ci uv install dependency (#11895)
|
2025-10-21 16:23:34 +08:00 |
|
Neelabh Sinha
|
852c0578fd
|
[FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570)
|
2025-10-21 15:44:33 +08:00 |
|
Atream
|
7e6191c098
|
init support for KTransformers Heterogeneous Computing (#11487)
Co-authored-by: Jianwei Dong <1913953267@qq.com>
|
2025-10-21 00:17:02 -07:00 |
|
Gaurav Verma
|
6f9b66bdda
|
[AMD] Update wave-lang to 3.8.0 (#11878)
Signed-off-by: xintin <gaurav.verma@amd.com>
|
2025-10-20 23:11:09 -07:00 |
|
Simo Lin
|
8a801ee38d
|
[router] release router 0.2.1 (#11885)
|
2025-10-20 21:08:45 -07:00 |
|
Qiaolin Yu
|
d9a20fd28a
|
Use trtllm_mla decode kernel for draft extend in speculative decoding (#11664)
|
2025-10-21 11:42:09 +08:00 |
|
Meng, Hengyu
|
b113c72e7a
|
Init attention backend for Intel XPU (#10656)
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
|
2025-10-21 11:41:28 +08:00 |
|
zhangdonghao-zdh
|
fb6cc7b000
|
Fix RotaryEmbedding for fp32 input (#11843)
|
2025-10-21 10:56:48 +08:00 |
|
Xiaoyu Zhang
|
8374a96e49
|
piecewise cuda graph support qwen3-moe (#11845)
|
2025-10-21 10:55:49 +08:00 |
|
Yuan Luo
|
74de76c685
|
Revise MRotaryEmbedding's forward (#11859)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
|
2025-10-21 10:38:29 +08:00 |
|
Chang Su
|
9c0b1eb5ad
|
[router][grpc] Fix wram-up random token ids for small models (#11887)
|
2025-10-20 19:22:17 -07:00 |
|
Lianmin Zheng
|
01f14a7ad2
|
[code move] move pp into a separate mixin (#11838)
|
2025-10-20 18:46:56 -07:00 |
|
Simo Lin
|
1111030395
|
[router] clean up workflow logs to debug for implementation details logs (#11886)
|
2025-10-20 18:24:55 -07:00 |
|
Tien Nguyen
|
28ddfb37d7
|
fix(sql-router): fix conflict port in test (#11826)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-10-20 18:06:34 -07:00 |
|
Chang Su
|
e69094df64
|
[router][grpc] Remove continue_final_message in ChatTemplateParams and add minijinja-contrib (#11882)
|
2025-10-20 18:03:09 -07:00 |
|
Lianmin Zheng
|
43ad05907c
|
[Auto Sync] Update scheduler.py, server_args.py (20251020) (#11875)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
|
2025-10-20 17:41:19 -07:00 |
|
Simo Lin
|
b4948512b8
|
[router] remove encoding header for oai router (#11881)
|
2025-10-20 17:39:00 -07:00 |
|
Simo Lin
|
ddcba74b4d
|
[router] Worker Management Workflow Engine (#11868)
|
2025-10-20 17:00:22 -07:00 |
|
fzyzcjy
|
0917c5da8c
|
Support mixing cutedsl and deepgemm backend (#11807)
|
2025-10-21 07:38:35 +08:00 |
|
penguin_wwy
|
184a4df697
|
Replace function call with set literal (#11867)
|
2025-10-21 01:39:16 +08:00 |
|
Qiaolin Yu
|
f7b1d8c5ab
|
Fix acc len and gen throughput metrics when enabling overlap-spec (#11823)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-10-21 01:34:38 +08:00 |
|
Cheng Wan
|
bfc3b3f786
|
[9/N] MoE Refactor: cleanup dispatcher interfaces (#11847)
|
2025-10-20 10:11:46 -07:00 |
|
Liangsheng Yin
|
da5bde4d16
|
Tiny fix main lint (#11862)
|
2025-10-20 19:57:24 +08:00 |
|
DarkSharpness
|
276e7b3e4e
|
[Feature] New structural tag support (#10691)
|
2025-10-20 18:25:58 +08:00 |
|
ishandhanani
|
296f689242
|
fix(server_args): handle tokenizer init conflicts (#11776)
|
2025-10-20 00:27:19 -07:00 |
|
Sai Enduri
|
9edb7b5123
|
[AMD CI] Populate image cache in nightly docker release. (#11822)
|
2025-10-20 00:04:04 -07:00 |
|
Sai Enduri
|
e53bf44243
|
Update amd gpu install docs. (#11849)
|
2025-10-20 00:03:26 -07:00 |
|
Shane A
|
d383e6616e
|
[Model] Add Olmo 3 model support (#11396)
|
2025-10-19 23:59:16 -07:00 |
|
Xiaoyu Zhang
|
984fbeb16b
|
Revert "[CI Monitor] Ci monitor only deal with main branch in default" (#11846)
|
2025-10-19 22:06:40 -07:00 |
|
Shangming Cai
|
a2ba0bc3df
|
Tiny clean up for PD module and doc (#11747)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-20 11:52:42 +08:00 |
|
Ziming Huang
|
6d2d0ce285
|
[PD] Improve eagle acceptance rate by transferring draft model hidden states (#10801)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-20 11:52:18 +08:00 |
|
Yuan Luo
|
271d3d0d50
|
Support mrope triton kernel and add unit test (#11722)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
|
2025-10-20 11:51:07 +08:00 |
|
ykcombat
|
c4e81e64fb
|
[Feature] Use current greenctx stream to communicate in PD-Multiplexing. (#11594)
|
2025-10-20 10:58:20 +08:00 |
|
harrisonlimh
|
c726d44cc7
|
Recapture cuda graph after model weight update to resolve IMA error (#11780)
|
2025-10-20 10:50:03 +08:00 |
|
sglang-bot
|
283c8ba031
|
chore: bump sgl-kernel version to 0.3.16.post3 (#11733)
|
2025-10-19 21:44:15 -05:00 |
|
huangtingwei
|
cae3956585
|
check master server for mooncake store (#10510)
|
2025-10-20 09:37:09 +08:00 |
|
Kangyan-Zhou
|
27a223aba4
|
Improve Kernel Build Time (#11508)
|
2025-10-19 18:11:48 -07:00 |
|
Kangyan-Zhou
|
53529f46cc
|
Fix version bump script to handle TOML files with outdated versions (#11787)
Co-authored-by: Claude <noreply@anthropic.com>
|
2025-10-19 18:10:26 -07:00 |
|
Xiaoyu Zhang
|
24ed3f32c0
|
fix(ci): Fix CI Monitor limit parameter and add CI Analysis to summary (#11832)
|
2025-10-19 18:08:34 -07:00 |
|
Baizhou Zhang
|
44f0ece9fc
|
[Doc] Update documents for FA4 (#11778)
|
2025-10-19 17:40:38 -07:00 |
|
Liu-congo
|
be0058bc05
|
[BugFix] replace the input_to_float8 used in dsv2 (#11612)
Signed-off-by: Liu-congo <1502632128@qq.com>
|
2025-10-19 19:34:13 -05:00 |
|
fzyzcjy
|
9e3be1fa2a
|
Tiny bump DeepEP version in ARM blackwell (#11810)
|
2025-10-20 08:15:14 +08:00 |
|
fzyzcjy
|
a8ba32798e
|
Fix triton_kernels import error on some hardwares (#11831)
|
2025-10-20 08:14:47 +08:00 |
|
hlu1
|
3b80232d06
|
[DeepseekV32] Add fast_topk_transform_ragged_fused kernel (#11815)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-10-19 17:13:39 -07:00 |
|
Johnny
|
252dc4e112
|
[NVIDIA] FA3/FA4 Fix (#11606)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-19 17:10:10 -07:00 |
|
Baizhou Zhang
|
cbb5fc2edc
|
[CI] Add CI test for DeepSeek V3.2 MTP (#11835)
|
2025-10-19 17:00:25 -07:00 |
|
Night
|
53fb229f53
|
[logprobs] Enable local deterministic logrprobs testing with strict threshold (#10994)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-19 13:30:39 -07:00 |
|
Stefan He
|
4fff1ec1d9
|
Deterministic Mode: Add 1-stage triton kernel for prefill (#11147)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
|
2025-10-20 01:47:36 +08:00 |
|
Liangsheng Yin
|
7a020e0f3b
|
[Test] Add basic matched stop for beta eagle (#11833)
|
2025-10-20 01:17:00 +08:00 |
|