Simo Lin
|
b341b7dbce
|
[router] introduce prefill response draining for http compliance (#9281)
|
2025-08-17 14:23:04 -07:00 |
|
fzyzcjy
|
b498cd21d7
|
Tiny make fp4 moe method parameters more static (#8520)
|
2025-08-17 13:26:02 -07:00 |
|
kousakawang
|
0fc54b971e
|
[fix]: fix cutlass moe ut and and Opt H20 cutlass groupGemm performance (#9272)
Co-authored-by: wanghanpei <wanghanpei@bytedance.com>
|
2025-08-17 13:09:49 -07:00 |
|
fzyzcjy
|
b3c1f2e4f2
|
Fix memory pool leak error (#9271)
|
2025-08-17 12:53:34 -07:00 |
|
Ke Bao
|
be1a3cd9b4
|
Fix swa eagle verify accuracy for Triton backend (#9279)
|
2025-08-17 12:52:02 -07:00 |
|
Lifu Huang
|
4b74c3fcca
|
[chore] Clean up redundant lora_weight_names concept to simplify code (#9131)
|
2025-08-17 12:36:58 -07:00 |
|
Jeff Nettleton
|
ce3ca9b02f
|
[router] add cargo clippy in CI and fix-up linting errors (#9242)
|
2025-08-17 11:03:56 -07:00 |
|
Liangsheng Yin
|
4d98e48649
|
Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260)
|
2025-08-17 22:59:50 +08:00 |
|
Netanel Haber
|
3d77a31885
|
from python.sglang.srt -> from sglang.srt (#9268)
|
2025-08-17 02:45:45 -07:00 |
|
Netanel Haber
|
845d12a979
|
model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067)
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
|
2025-08-17 01:48:15 -07:00 |
|
Stefan He
|
e47800e176
|
Quick Fix GLM (#9264)
|
2025-08-16 23:43:41 -07:00 |
|
Simo Lin
|
bb10e3a1c3
|
[router] fix pd prefill http request complinace issue (#9237)
|
2025-08-16 22:36:45 -07:00 |
|
Even Zhou
|
fda762a27d
|
[Bugfix] Change vLLM install order & Add A2 support (#9232)
|
2025-08-16 22:36:14 -07:00 |
|
Mick
|
1df84ff414
|
ci: simplify multi-modality tests by using mixins (#9006)
|
2025-08-16 22:25:02 -07:00 |
|
Binyao Jiang
|
66d6be0874
|
Bug fix: use correct mm_items in embed_mm_inputs (#8893)
|
2025-08-16 19:55:56 -07:00 |
|
kk
|
1c1f8a118e
|
Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4 quantization in mxfp4.py (#9049)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-08-16 19:01:54 -07:00 |
|
Shangming Cai
|
384f8ab5ce
|
[PD] Support PD disaggregation with Prefill PP (#8846)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: root <huzhiyuan@xiaohongshu.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Francis <38564764+ssssnow@users.noreply.github.com>
Co-authored-by: zitto <zhjc1124@gmail.com>
|
2025-08-16 18:31:31 -07:00 |
|
zyksir
|
6a9d6ca33c
|
fix unexcepted answer in EAGLE mode (#9252)
|
2025-08-16 17:45:36 -07:00 |
|
VDV1985
|
94371dbbd6
|
[feature] Ascend NPU graph support (#8027)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
|
2025-08-16 17:25:17 -07:00 |
|
Sai Enduri
|
740f063035
|
Fix Custom All Reduce CI job. (#9258)
|
2025-08-16 16:29:43 -07:00 |
|
Hank Han
|
81da16f6d3
|
[CI] add deepseek w4a8 test on h20 ci (#7758)
|
2025-08-16 01:54:13 -07:00 |
|
Brayden Zhong
|
bc938ea13f
|
Fix DP load for embedding (#9165)
|
2025-08-15 23:58:44 -07:00 |
|
Trevor Morris
|
eff4eb3fdd
|
Add fp4 quantize before all-gather for Flashinfer cutlass MoE DP (max throughput) (#7667)
|
2025-08-15 22:08:11 -07:00 |
|
Yineng Zhang
|
87dab54824
|
Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247)
|
2025-08-15 17:24:36 -07:00 |
|
Yineng Zhang
|
5121af4627
|
Revert "chore(docker): update sgl_kernel version to 0.3.6 in Dockerfi… (#9246)
|
2025-08-15 17:19:38 -07:00 |
|
kk
|
983aa4967b
|
Fix nan value generated after custom all reduce (#8663)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-08-15 12:33:54 -07:00 |
|
Hubert Lu
|
9c3e95d98b
|
[AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268)
|
2025-08-15 12:32:51 -07:00 |
|
ishandhanani
|
e52c3866eb
|
chore(docker): update sgl_kernel version to 0.3.6 in Dockerfile.gb200 (#9243)
|
2025-08-15 12:06:52 -07:00 |
|
Simo Lin
|
da53e13cbb
|
[router] preserve original worker response header in router (#9236)
|
2025-08-15 11:01:47 -07:00 |
|
Jeff Nettleton
|
d7e38b2f6d
|
[router] clean up lint warnings with clippy execution (#9201)
|
2025-08-15 11:01:21 -07:00 |
|
Simo Lin
|
21b8846066
|
[router] allow more health check configuration (#9198)
|
2025-08-15 08:07:45 -07:00 |
|
Liangsheng Yin
|
0c8594e67d
|
Optional extension for green context (#9231)
|
2025-08-15 21:33:52 +08:00 |
|
Yineng Zhang
|
c186feed7f
|
chore: bump sgl-kernel v0.3.6 (#9220)
|
2025-08-15 02:50:50 -07:00 |
|
Cheng Wan
|
84b006b278
|
Cleanup MoE Refactor (#9223)
|
2025-08-15 02:28:33 -07:00 |
|
Shangming Cai
|
8ca07bd948
|
[CI] Fix sgl-router disaggregation test (#9222)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-15 02:24:44 -07:00 |
|
jy-song-hub
|
4fc09e0df0
|
Fp4 MOE quant kernel optimization (#8777)
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
|
2025-08-15 01:46:16 -07:00 |
|
PGFLMG
|
a3d99d6dcd
|
[Misc] feat: Deepgemm update for sgl-kernel (#8790)
|
2025-08-15 01:05:27 -07:00 |
|
Xuchun Shang
|
189af90896
|
[Eagle Warning fix] replace the deprecated 'and' with & (#9215)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
|
2025-08-15 15:43:36 +08:00 |
|
fzyzcjy
|
f8644a5632
|
Tiny update tmux history limit on dev container (#9218)
|
2025-08-15 00:22:08 -07:00 |
|
Cheng Wan
|
e3e75a786a
|
Fix the deprecation warning for enable_flashinfer_mxfp4_moe (#9214)
|
2025-08-14 23:59:35 -07:00 |
|
shilinlee
|
d4db9b028b
|
fix: the store_dtype typo for ascend mla (#9208)
Signed-off-by: shilinlee_com <836160610@qq.com>
|
2025-08-14 23:58:42 -07:00 |
|
hzh0425
|
f7dd651dbd
|
feat(hicache-3fs): 3FS-SGLang Hierarchical Cache Deployment Guide (#9213)
|
2025-08-14 23:54:31 -07:00 |
|
Yineng Zhang
|
9d54c6e6dd
|
feat: remove sm75 (#9207)
|
2025-08-14 22:27:14 -07:00 |
|
strgrb
|
1f9d65f57d
|
use fast math for per_token_group_quant_8bit. (#9177)
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
|
2025-08-14 22:19:56 -07:00 |
|
Cheng Wan
|
295895120d
|
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
|
2025-08-14 21:14:53 -07:00 |
|
Mick
|
584e1ab2d0
|
fix: fix unsupported palette mode of images in bench_serving for mmmu (#9206)
|
2025-08-14 18:44:46 -07:00 |
|
fzyzcjy
|
392de007cb
|
Minor fix docker container DeepEP on multi platforms (#9205)
|
2025-08-14 17:41:49 -07:00 |
|
Philo
|
004f7f1972
|
[typo fix] Fix a typo in communicator.py (#9183)
Signed-off-by: Philo <lul16@foxmail.com>
|
2025-08-14 17:29:38 -07:00 |
|
zixuanzhang226
|
d2fbf2de0c
|
feat: add fused moe config for Qwen3-235B-A22B-FP8 on B200 (#9204)
|
2025-08-14 17:21:30 -07:00 |
|
Yineng Zhang
|
fab0f6e77d
|
chore: bump v0.5.0rc2 (#9203)
|
2025-08-14 16:11:16 -07:00 |
|