Baizhou Zhang
|
3fa3c22ae2
|
Fix fast decode plan for flashinfer v0.4.0rc1 and upgrade sgl-kernel 0.3.11 (#10634)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-09-19 01:25:29 -07:00 |
|
Simo Lin
|
4f2055ad56
|
[router] refactor worker to builder pattern 4/n (#10650)
|
2025-09-18 23:49:10 -07:00 |
|
Yuan Luo
|
616a3e20df
|
[sgl-kernel] Support moe_sum_reduce cuda kernel (#10321)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-09-19 14:12:09 +08:00 |
|
Simo Lin
|
ac2a723bb3
|
[router] refactor worker to builder pattern 3/n (#10647)
|
2025-09-18 22:52:57 -07:00 |
|
Jimmy
|
56b991b12d
|
[Feature]feat(get_ip): unify get_ip_xxx (#10081)
|
2025-09-18 22:35:26 -07:00 |
|
Simo Lin
|
780d6a22cd
|
[router] refactor worker to builder pattern 2/n (#10633)
|
2025-09-18 21:47:56 -07:00 |
|
FlyPanda
|
8b713c7248
|
Hicache L3 backend mooncake optimization configuration reading method (#10319)
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: shicang <shicang@shicang>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-19 12:25:01 +08:00 |
|
Yineng Zhang
|
5bfafdfcb4
|
chore: bump sgl-kernel 0.3.11 (#10630)
|
2025-09-18 18:43:20 -07:00 |
|
zixuanzhang226
|
8c52de6fab
|
feat: add fused moe config for Qwen3-Next-80B-A3B-Instruct on B200 (#10631)
|
2025-09-18 17:31:58 -07:00 |
|
Chang Su
|
c1815a99b7
|
model support: Sarashina2VisionForCausalLM (#10632)
|
2025-09-18 17:30:38 -07:00 |
|
Binyao Jiang
|
4e6c4923a0
|
[Performance] Qwen3-Next: speed up update_mamba_state_after_mtp_verify by 10x; e2e up to 3.54% faster (#10586)
|
2025-09-18 17:13:59 -07:00 |
|
Binyao Jiang
|
b91cb67e7a
|
[Performance] Qwen3-Next: replace arange to cached query_start_loc_li… (#10553)
|
2025-09-18 17:02:42 -07:00 |
|
Zhihao Zhang
|
e7bc600304
|
[Feature] Speculative decoding support lookahead (#9873)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2025-09-18 16:42:41 -07:00 |
|
Yineng Zhang
|
2a2ff9a840
|
refactor: use registry for _get_attention_backend_from_str (#10629)
|
2025-09-18 16:27:59 -07:00 |
|
Simo Lin
|
5291f32d75
|
[router] refactor worker to builder pattern 1/n (#10628)
|
2025-09-18 13:25:40 -07:00 |
|
brayden-hai
|
67073dde85
|
Garbage collector regression in the online server (#10621)
|
2025-09-18 11:52:35 -07:00 |
|
yuk.igalaxy
|
9a5c42f9ad
|
feat: Add FlexAttention Backend for Efficient Sparse Attention (#9947)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-09-18 11:49:17 -07:00 |
|
yhyang201
|
388c05d544
|
Fix bias handling in TritonMoeQuantInfo within quantization/mxfp4.py (#10579)
|
2025-09-18 11:44:43 -07:00 |
|
Jinyan Chen
|
fc809665fd
|
[Performance] qwen3-next improve causal conv1d in prefill phase (#10595)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
|
2025-09-18 11:42:49 -07:00 |
|
Zaili Wang
|
6fd4816d9f
|
Fix sgl_kernel import failure on devices other than CUDA (#10610)
|
2025-09-18 11:38:02 -07:00 |
|
Yi Zhang
|
1344ebc833
|
support qwen3-next-fp8 deepep (#10622)
|
2025-09-18 11:36:22 -07:00 |
|
Yi Zhang
|
e07b21ceaf
|
update deepep version for qwen3-next deepep moe (#10624)
|
2025-09-18 11:35:22 -07:00 |
|
shaharmor98
|
52f248cd31
|
Feat/add heartbeat mechanism for nixl conn (#10222)
Signed-off-by: Shahar Mor <smor@nvidia.com>
|
2025-09-18 10:20:42 -07:00 |
|
penguin_wwy
|
93f75778be
|
[RL] Add destroy process group api (#9979)
|
2025-09-19 00:31:56 +08:00 |
|
AlphaBaby
|
4039c626e2
|
fix deepep assert when PD disaggregation == null (#8274)
Co-authored-by: fujianhao.fjh <fujianhao.fjh@antgroup.com>
|
2025-09-19 00:31:01 +08:00 |
|
Yi Zhang
|
db71c38fcd
|
Scale kkt after reduction (#10604)
|
2025-09-18 20:51:40 +08:00 |
|
zhannngchen
|
7a68b4225a
|
[improvement] add average input/output token length for hicache benchmark stats output (#10525)
|
2025-09-18 00:38:03 -07:00 |
|
Shangming Cai
|
60fc5b51f6
|
chore: upgrade mooncake 0.3.6 (#10596)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-18 00:19:30 -07:00 |
|
Shangming Cai
|
a13dd1e492
|
[PD] Improve disaggregation common backend and refactor mooncake backend (#10273)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-17 22:58:07 -07:00 |
|
HAI
|
d500eb9173
|
aiter v0.1.5.post2 (#10563)
|
2025-09-17 22:10:45 -07:00 |
|
Xuchun Shang
|
1ccd59c715
|
[HICache] introduce evict policy (#10190)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-18 11:10:20 +08:00 |
|
sogalin
|
c32fb7a24d
|
[ROCm] Fix fp8 quantization accuracy issue. (#10558)
|
2025-09-17 17:44:59 -07:00 |
|
Shu Wang
|
1ba137e98f
|
Enable trtllm mla prefix extend (#10526)
|
2025-09-17 16:44:11 -07:00 |
|
Kevin Xiang Li
|
de28f8e741
|
vlm: remove redundant d2h movement of mm feature tensors (#9987)
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
|
2025-09-17 15:00:39 -07:00 |
|
Yineng Zhang
|
564050766d
|
fix: update dsv3 fp4 ut (#10584)
|
2025-09-17 14:34:58 -07:00 |
|
Ziming Huang
|
b73ac629cd
|
[BugFix] Fix incorrect hidden_states_tensor in pd disaggregation + eagle (#9976)
|
2025-09-17 10:37:14 -07:00 |
|
Teng Ma
|
77098aea7b
|
[HiCache] Add tests for hicache storage mooncake backend (#10171)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-18 01:07:16 +08:00 |
|
Liangsheng Yin
|
5ccf0b03bd
|
[bench] Fix random seed in bench_one_batch_server (#10548)
|
2025-09-17 19:30:32 +08:00 |
|
EduardDurech
|
a77564e0fb
|
CUDA Arch Independent (#8813)
|
2025-09-16 23:01:45 -07:00 |
|
Yichen Yan
|
4f9e71df3c
|
Remove duplicated code (#10545)
Co-authored-by: jiapingW <56055330+jiapingW@users.noreply.github.com>
|
2025-09-16 20:48:22 -07:00 |
|
zhannngchen
|
541551cefe
|
[bugfix]hicache bench_long_context.py run failed (#10523)
|
2025-09-17 11:27:06 +08:00 |
|
Shu Wang
|
124097fc5b
|
enable prefix cache with dp (#10459)
|
2025-09-16 18:26:58 -07:00 |
|
kyleliang-nv
|
e1d45bc280
|
Fix decord dependency for aarch64 docker build (#10529)
|
2025-09-16 17:34:37 -07:00 |
|
harrisonlimh
|
14fdd52740
|
feat: add priority based scheduling with priority based request acceptance and preemption (#8746)
|
2025-09-16 17:10:10 -07:00 |
|
Lianmin Zheng
|
f949ad5794
|
[Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-16 17:06:43 -07:00 |
|
Lianmin Zheng
|
c49484a658
|
[Auto Sync] Update scheduler_profiler_mixin.py, rpd_utils.p... (20250916) (#10494)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2025-09-16 17:02:20 -07:00 |
|
cicirori
|
a2f7218a2e
|
support using fa4 on deepseek on blackwell (#9928)
|
2025-09-16 16:16:06 -07:00 |
|
fzyzcjy
|
311de47bb7
|
[2/2] Speed up trtllm_mla attention backend (#10474)
|
2025-09-16 15:49:22 -07:00 |
|
gongwei-130
|
373080ea6c
|
skip vision_model for lora (#10530)
|
2025-09-16 12:34:42 -07:00 |
|
Philip Kiely - Baseten
|
7f028b07c4
|
Fix formatting in long code blocks (#10528)
|
2025-09-16 12:02:05 -07:00 |
|