Keyang Ru
|
c5057262fa
|
[Router] Add validation module for API parameters (#9335)
|
2025-08-19 13:25:53 -07:00 |
|
Chang Su
|
46fe8b8cb2
|
[CI] Fix lint issues (#9361)
|
2025-08-19 13:05:36 -07:00 |
|
Simo Lin
|
0b95a01a8f
|
[router] add tiktokenizer and sequence in router (#9354)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-19 10:46:28 -07:00 |
|
mpashkovskiy
|
a3b810ebdb
|
fix: enable multi-GPU Triton fused MoE tuning (#6295)
|
2025-08-19 10:16:58 -07:00 |
|
Simo Lin
|
94959237bf
|
[router] add dsr1, kimi, and qwen reasoning parser (#9353)
|
2025-08-19 10:15:24 -07:00 |
|
Even Zhou
|
f4fafacc5d
|
Revert "[feature] Ascend NPU graph support (#8027)" (#9348)
|
2025-08-19 10:11:23 -07:00 |
|
chenxu140
|
01d47a27b6
|
[Bugfix] fix kv buffer register & dp attention & deepepmoe (#9327)
|
2025-08-19 10:09:48 -07:00 |
|
Lianmin Zheng
|
ecc9f3e47a
|
[Minor] Fix the style of sgl-kernel (#9332)
|
2025-08-18 23:45:00 -07:00 |
|
Yineng Zhang
|
7e8187e004
|
docs: fix spec (#9326)
|
2025-08-18 19:35:46 -07:00 |
|
Enrique Shockwave
|
e483ab6d20
|
enable marlin fp8 blockwise (#8990)
|
2025-08-18 18:53:15 -07:00 |
|
EduardDurech
|
720cd308ba
|
Add CMakeLists.txt binary_dir (#7019)
|
2025-08-18 18:36:33 -07:00 |
|
Keyang Ru
|
ce67b2d586
|
[router]restructure protocol modules for better organization (#9321)
|
2025-08-19 01:07:58 +00:00 |
|
Jiaqi Gu
|
3c2c9f6c9e
|
[Bug] Fix input arguments of flashinfer_trtllm_moe (#9317)
|
2025-08-18 18:03:19 -07:00 |
|
zxy
|
a31ea44824
|
support for interns1-mini (#9299)
|
2025-08-18 17:56:04 -07:00 |
|
Chang Su
|
439df4548a
|
[router] Add spec for sglang scheduler (#9322)
|
2025-08-18 17:20:20 -07:00 |
|
fzyzcjy
|
5626e20b2b
|
Tiny fix CI (#9306)
|
2025-08-18 16:54:36 -07:00 |
|
Hubert Lu
|
c6c379ab31
|
[AMD] Reorganize hip-related header files in sgl-kernel (#9320)
|
2025-08-18 16:53:44 -07:00 |
|
Binyao Jiang
|
c2fbf60f39
|
[GLM4.1V and GLM4.5V] Add vision transformer num_dummy_head support: max tp=4 -> max tp=8 (#9059)
|
2025-08-18 14:40:13 -07:00 |
|
datdo-msft
|
98b44e9e56
|
[PD] Propagate internal server errors from aborted requests to clients instead of blindly returning 200's (#8936)
|
2025-08-18 14:23:46 -07:00 |
|
Swipe4057
|
6805f6da40
|
upgrade xgrammar 0.1.23 and openai-harmony 0.0.4 (#9284)
|
2025-08-18 14:02:00 -07:00 |
|
江家瑋
|
ca533580f2
|
[Docs] Correct and clarify notes in Engine docstring (#9313)
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
|
2025-08-18 13:24:19 -07:00 |
|
Keyang Ru
|
886454e8e7
|
[MISC] use dynamic choices for tool-call-parser argument (#9316)
|
2025-08-18 13:02:10 -07:00 |
|
gongwei-130
|
0cf3fbeb18
|
should return invalide request for empty prompt (#9315)
|
2025-08-18 11:44:11 -07:00 |
|
Zhiyu
|
2256d62d36
|
Modelopt quant config adaptation (#8829)
|
2025-08-18 11:27:30 -07:00 |
|
JieXin Liang
|
6cdcbcc674
|
[fix] fix enable_pdl for blackwell (#9011)
|
2025-08-19 01:16:08 +08:00 |
|
Lianmin Zheng
|
c480a3f6ea
|
Minor style fixes for sgl-kernel (#9289)
|
2025-08-18 09:38:35 -07:00 |
|
Simo Lin
|
6e316588f8
|
[router] add reasoning parser base structure (#9310)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-18 09:26:09 -07:00 |
|
Simo Lin
|
24247b4168
|
[router] add tokenizer metrics (#9307)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-18 09:25:51 -07:00 |
|
fzyzcjy
|
4c0bb411e5
|
Further fix memory pool leak error (#9298)
|
2025-08-18 00:58:06 -07:00 |
|
Yuan Luo
|
968e181826
|
Fix triton_fused_moe unit test and benchmark (#9276)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-08-18 00:54:33 -07:00 |
|
Simo Lin
|
d08663eec1
|
[router] tokenizer factory, hf tokenizer, and stop sequence detector (#9293)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-17 22:38:38 -07:00 |
|
b8zhong
|
716e682721
|
[Fix] Add undefined update_tensor_inplace function (#6307)
|
2025-08-18 11:11:00 +08:00 |
|
zifeitong
|
84b30d9e00
|
Set the default attention backend for GLM-4.5v to fa3 (#9245)
|
2025-08-17 16:34:19 -07:00 |
|
Simo Lin
|
ff0cf51c8e
|
[router] introducing tokenizer trait (#9287)
|
2025-08-17 16:30:01 -07:00 |
|
Yineng Zhang
|
a1c7f742f9
|
chore: bump sgl-kernel v0.3.6.post1 (#9286)
|
2025-08-17 16:26:17 -07:00 |
|
blzheng
|
ebbb75e917
|
[CPU] Fix TP padding issue on Phi-4 (#8289)
|
2025-08-17 16:25:26 -07:00 |
|
Simo Lin
|
b341b7dbce
|
[router] introduce prefill response draining for http compliance (#9281)
|
2025-08-17 14:23:04 -07:00 |
|
fzyzcjy
|
b498cd21d7
|
Tiny make fp4 moe method parameters more static (#8520)
|
2025-08-17 13:26:02 -07:00 |
|
kousakawang
|
0fc54b971e
|
[fix]: fix cutlass moe ut and and Opt H20 cutlass groupGemm performance (#9272)
Co-authored-by: wanghanpei <wanghanpei@bytedance.com>
|
2025-08-17 13:09:49 -07:00 |
|
fzyzcjy
|
b3c1f2e4f2
|
Fix memory pool leak error (#9271)
|
2025-08-17 12:53:34 -07:00 |
|
Ke Bao
|
be1a3cd9b4
|
Fix swa eagle verify accuracy for Triton backend (#9279)
|
2025-08-17 12:52:02 -07:00 |
|
Lifu Huang
|
4b74c3fcca
|
[chore] Clean up redundant lora_weight_names concept to simplify code (#9131)
|
2025-08-17 12:36:58 -07:00 |
|
Jeff Nettleton
|
ce3ca9b02f
|
[router] add cargo clippy in CI and fix-up linting errors (#9242)
|
2025-08-17 11:03:56 -07:00 |
|
Liangsheng Yin
|
4d98e48649
|
Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260)
|
2025-08-17 22:59:50 +08:00 |
|
Netanel Haber
|
3d77a31885
|
from python.sglang.srt -> from sglang.srt (#9268)
|
2025-08-17 02:45:45 -07:00 |
|
Netanel Haber
|
845d12a979
|
model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067)
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
|
2025-08-17 01:48:15 -07:00 |
|
Stefan He
|
e47800e176
|
Quick Fix GLM (#9264)
|
2025-08-16 23:43:41 -07:00 |
|
Simo Lin
|
bb10e3a1c3
|
[router] fix pd prefill http request complinace issue (#9237)
|
2025-08-16 22:36:45 -07:00 |
|
Even Zhou
|
fda762a27d
|
[Bugfix] Change vLLM install order & Add A2 support (#9232)
|
2025-08-16 22:36:14 -07:00 |
|
Mick
|
1df84ff414
|
ci: simplify multi-modality tests by using mixins (#9006)
|
2025-08-16 22:25:02 -07:00 |
|