Lianmin Zheng
|
6beeff41c5
|
Update REVIEWERS.md (#9046)
|
2025-08-10 21:11:14 -07:00 |
|
Lianmin Zheng
|
2e8e7e353b
|
Improve docs and developer guide (#9044)
|
2025-08-10 21:05:18 -07:00 |
|
Lianmin Zheng
|
2449a0afe2
|
Refactor the docs (#9031)
|
2025-08-10 19:49:45 -07:00 |
|
Lianmin Zheng
|
0f229c07f1
|
Update release-docs.yml (#9037)
|
2025-08-10 18:52:11 -07:00 |
|
Yineng Zhang
|
dd001a5477
|
chore: upgrade flashinfer 0.2.11 (#9036)
|
2025-08-10 17:35:37 -07:00 |
|
Lianmin Zheng
|
4ea9d74a3e
|
Simplify health check (#9034)
|
2025-08-10 17:35:05 -07:00 |
|
Yineng Zhang
|
dd949ace23
|
Revert "[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into m… (#9035)
|
2025-08-10 17:34:54 -07:00 |
|
Lianmin Zheng
|
f2887498f0
|
Simplify memory pool (#9033)
|
2025-08-10 17:32:28 -07:00 |
|
Stefan He
|
8ecf6b9d24
|
Support Flatten Tensor Update Weights to speed up MOE Update Weights by 20% (#8079)
|
2025-08-10 16:08:59 -07:00 |
|
YiXR
|
0418b9d4ea
|
[Optimization] Update estimated_num_new_pages logic in TokenToKVPoolAllocator (#8794)
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
Co-authored-by: Xingrui Yi <yixingrui@linux.alibaba.com>
|
2025-08-10 16:01:51 -07:00 |
|
Lifu Huang
|
e322a94d1f
|
Reduce CI duration of test_lora_update. (#9024)
|
2025-08-10 15:34:04 -07:00 |
|
Lianmin Zheng
|
2c7f01bc89
|
Reorganize CI and test files (#9027)
|
2025-08-10 12:30:06 -07:00 |
|
Lianmin Zheng
|
b58ae7a2a0
|
Simplify frontend language (#9029)
|
2025-08-10 10:59:30 -07:00 |
|
Stefan He
|
6345069f6c
|
[RL] Add test for /abort_request (#7626)
|
2025-08-10 09:14:19 -07:00 |
|
Simo Lin
|
ce9cf35327
|
[router] update pyo3 version to 0.25.1 (#9022)
|
2025-08-10 06:45:51 -07:00 |
|
Lifu Huang
|
f8a173bb50
|
Improve LoRA Perf by Deprecating FlashInfer and Eliminating Redundant Tensor Ops (#8940)
|
2025-08-10 01:04:45 -07:00 |
|
JiLi
|
6b847a9a05
|
Optimize: Cache CUDA device to reduce redundant calls during tensor l… (#8996)
|
2025-08-10 00:32:57 -07:00 |
|
Simo Lin
|
473400e452
|
[router] upgrade kube version to latest (#9018)
|
2025-08-09 22:49:45 -07:00 |
|
Simo Lin
|
dd665f967f
|
[router] upgrade rand to latest version (#9017)
|
2025-08-09 22:49:30 -07:00 |
|
Simo Lin
|
3817a37d87
|
[router] upgrade to latest sgl kernel for router ci (#9019)
|
2025-08-09 21:49:18 -07:00 |
|
DarkSharpness
|
7ba5ad5766
|
[Fix] Fix flashinfer cpu <-> gpu synchronization (#8340)
|
2025-08-10 03:11:40 +00:00 |
|
DarkSharpness
|
19bc77f05c
|
[Fix] Fix hicache backend (#8991)
|
2025-08-09 17:16:25 -07:00 |
|
huangtingwei
|
86497d99f2
|
fix page first per layer pf2lf kernel (#8915)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 17:16:11 -07:00 |
|
cctry
|
5c31b35db2
|
[hicache] Optimization for DMA copy (#8245)
|
2025-08-09 17:16:07 -07:00 |
|
Lianmin Zheng
|
ef48d5547e
|
Fix CI (#9013)
|
2025-08-09 16:00:10 -07:00 |
|
Xiaoyu Zhang
|
a886564a18
|
fix flashinfer allreduce fusion import bug (#9007)
|
2025-08-09 13:47:05 -07:00 |
|
Lianmin Zheng
|
9a44b643c6
|
Fix CI (#9012)
|
2025-08-09 13:33:42 -07:00 |
|
Mick
|
41d71ca488
|
fix: fix obsolete qwen-audio processor arg (#9003)
|
2025-08-09 13:18:36 -07:00 |
|
JieXin Liang
|
20cfc5a251
|
[perf] add kimi-k2 b200 fused moe config (#9010)
|
2025-08-09 12:40:49 -07:00 |
|
Yineng Zhang
|
48b8b4c124
|
fix nvshmem cu126 (#9001)
|
2025-08-09 03:34:54 -07:00 |
|
Chaitanya Sri Krishna Lolla
|
323bc2f51a
|
Enable TBO on ROCm (#8329)
|
2025-08-09 01:59:55 -07:00 |
|
Even Zhou
|
137e75daa1
|
[Feature] Optimize DeepSeek's DeepEP on Ascend NPU (#8355)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Hexq0210 <hexq0809521@gmail.com>
|
2025-08-09 01:35:00 -07:00 |
|
Trevor Morris
|
52e1f52f32
|
[bugfix] Fix missing args in bench one batch (#8877)
|
2025-08-09 01:34:03 -07:00 |
|
Cheng Wan
|
5018809222
|
[DP] fix: engine crash when decode batch is padded (#8995)
|
2025-08-09 01:29:29 -07:00 |
|
Yineng Zhang
|
326a901df4
|
chore: upgrade sgl-kernel 0.3.3 (#8998)
|
2025-08-09 01:22:01 -07:00 |
|
Zhiqiang Xie
|
6e0b646832
|
HiCache Storage tp fix (#8878)
|
2025-08-09 01:16:51 -07:00 |
|
Brayden Zhong
|
4a9f3eef90
|
Tiny Llama4 type error in constructor (#6752)
|
2025-08-09 01:03:59 -07:00 |
|
hzh0425
|
1b7afad0dd
|
feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 01:03:00 -07:00 |
|
Binyao Jiang
|
f29aba8c6e
|
Support glm4.1v and glm4.5v (#8798)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>
|
2025-08-09 00:59:13 -07:00 |
|
eigen
|
faa25df1ae
|
feat: update flashinfer ar oneshot params (#8687)
|
2025-08-09 00:51:27 -07:00 |
|
Binyao Jiang
|
7b81f956eb
|
Fix qwen2 audio not working bug (#8600)
|
2025-08-09 00:42:29 -07:00 |
|
fzyzcjy
|
d3e67deb1b
|
Fix redundant kernel in sink dtype conversion (#8966)
|
2025-08-09 00:34:49 -07:00 |
|
fzyzcjy
|
442534aa44
|
Add CI for gpt-oss model on hopper (#8851)
|
2025-08-09 00:34:23 -07:00 |
|
ishandhanani
|
de8b8b6e5c
|
chore(deps): update minimum python to 3.10 (#8984)
|
2025-08-09 00:30:23 -07:00 |
|
tql.99
|
3f2e315f6e
|
optimize: reduce shulffle and quantization overhead in cutlass_moe sm90 (#8962)
Co-authored-by: 戚余航 <qiyuhang@bytedance.com>
|
2025-08-09 00:29:12 -07:00 |
|
Lifu Huang
|
6e2151183b
|
Fix incorrect default get_hidden_dim logic (#8987)
|
2025-08-09 00:25:38 -07:00 |
|
Cheng Wan
|
a47baff12c
|
[hotfix] use the original implementation in 8785 (#8994)
|
2025-08-08 21:47:25 -07:00 |
|
Cheng Wan
|
fd7e15b76d
|
Revert "[bug fix] Ensure local token and global token buffers are pointing to different storage " (#8993)
|
2025-08-08 21:34:17 -07:00 |
|
DarkSharpness
|
fc42ff7b63
|
[Fix] Fix wrong backend chosen in hybrid backend (#8989)
|
2025-08-08 21:21:17 -07:00 |
|
DiweiSun
|
7c0db868a1
|
Molly/ci gnr server (#8667)
|
2025-08-08 20:01:16 -07:00 |
|