Xiaoyu Zhang
|
6f16bf9d9d
|
[Ci Monitor] Auto uploaded performance data to sglang_ci_data repo (#10976)
|
2025-09-29 16:17:27 +08:00 |
|
Yineng Zhang
|
5942fdb480
|
chore: upgrade cutedsl 4.2.1 (#11054)
|
2025-09-29 00:24:17 -07:00 |
|
Chang Su
|
af4ab65606
|
[router][tool call] Improve normal content extraction and error handling (non-stream) (#11050)
|
2025-09-29 00:19:30 -07:00 |
|
Xiaoyu Zhang
|
11965b0daf
|
Fix sgl-kernel benchmark dead code (#11022)
|
2025-09-29 15:06:40 +08:00 |
|
Vincent Zhong
|
71959545df
|
Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614)
|
2025-09-29 06:18:29 +00:00 |
|
Zhihao Zhang
|
24f7cb1ece
|
[speculative decoding] rename lookahead to ngram (#11010)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-09-28 21:06:59 -07:00 |
|
huangtingwei
|
e05555fad8
|
[HiCacheStorage] mooncake store support page_first_direct layout (#10591)
|
2025-09-28 20:45:48 -07:00 |
|
Mick
|
43fa9f22bd
|
fix: check if weights are already local before downloading (#11015)
|
2025-09-28 20:11:33 -07:00 |
|
Lifu Huang
|
e98d9346c7
|
[1/2] Support FA4 for MHA Prefill in sgl-kernel (#10940)
|
2025-09-28 19:59:14 -07:00 |
|
Kangyan-Zhou
|
0c9174108a
|
Unify SGL Kernel Releases (#10701)
|
2025-09-28 19:48:28 -07:00 |
|
Simo Lin
|
2572886367
|
[router] add harmony tool parser base structure and interface (#11036)
|
2025-09-28 19:46:38 -07:00 |
|
Chang Su
|
dba751a896
|
[router][tool call] Support normal content extraction before tool call (streaming) (#11038)
|
2025-09-28 19:46:06 -07:00 |
|
Mick
|
2e7633982c
|
fix: show failed models in nightly ci (#10986)
|
2025-09-28 12:38:29 -07:00 |
|
Simo Lin
|
336e9a6058
|
[router] migrate to rust python module for pythonic parser (#11033)
|
2025-09-28 14:48:59 -04:00 |
|
Yuxuan Zhang
|
abb6781573
|
Update GLM-4.5 Model Doc (#11017)
|
2025-09-28 11:21:27 -07:00 |
|
Lianmin Zheng
|
07440f5f34
|
Fix FusedSetKVBufferArg in RotaryEmbedding (#11003)
|
2025-09-28 11:17:27 -07:00 |
|
Teng Ma
|
9816989bff
|
[HiCache] bug: fix mooncake store batch set v1 (#11013)
|
2025-09-28 23:18:48 +08:00 |
|
Yuan Luo
|
42245551ef
|
[sgl-kernel] Optimize concat_mla_k kernel (#10543)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>
|
2025-09-28 23:04:22 +08:00 |
|
lbk-sys
|
2a9d995c09
|
prepare for sglang+verl (#10555)
Signed-off-by: lbk-sys <hello_lbk@163.com>
Signed-off-by: libaokui <libaokui@hauwei.com>
Co-authored-by: libaokui <libaokui@hauwei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2025-09-28 01:39:17 -07:00 |
|
wejoncy
|
a9050b5c39
|
[bugfix]Add empty_context import to two_batch_overlap.py (#10964)
|
2025-09-28 01:26:20 -07:00 |
|
YanbingJiang
|
66face3598
|
Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' (#11009)
|
2025-09-28 00:31:08 -07:00 |
|
Simo Lin
|
5519766a4d
|
[router] fix chat template loading and tokenizer path (#10999)
|
2025-09-27 23:54:12 -04:00 |
|
Keyang Ru
|
72392f2908
|
[router] basic mcp support for openai router response api (#10978)
|
2025-09-27 21:49:33 -04:00 |
|
Chang Su
|
c1c8dd1dd0
|
[router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) (#10995)
|
2025-09-27 18:10:17 -04:00 |
|
Lianmin Zheng
|
f6bc3f529b
|
Fix profiler (#10997)
|
2025-09-27 14:56:18 -07:00 |
|
Tejesh Anand
|
8cc27fdc46
|
Use jsonschema to constrain required or specific tool choice (#10550)
|
2025-09-27 13:18:50 -04:00 |
|
Shangming Cai
|
9c339d6b47
|
[PD] Extract the PP transfer layer calculate logic from Mooncake to Common backend (#10565)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-28 00:10:41 +08:00 |
|
Shangming Cai
|
e23e280e16
|
Add support for topk metadata transferring for PD (#10616)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-28 00:09:38 +08:00 |
|
Muqi Li
|
51f7c6bd3c
|
Add auth to get server info (#10751)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-09-27 02:54:39 -07:00 |
|
Xinyuan Tong
|
62e2e99db6
|
fix: make inference deterministic for large TP (#10930)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-09-27 02:46:45 -07:00 |
|
kk
|
8ebf72fef3
|
[Fix] RuntimeError: get_cfg Unsupported input_type:Float4_e2m1fn_x2 in using aiter-mxfp4-moe (#10981)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-09-26 22:12:22 -07:00 |
|
Yueyang Pan
|
8260574729
|
fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112)
Signed-off-by: PanJason <pyyjason@gmail.com>
|
2025-09-27 05:05:23 +00:00 |
|
Chang Su
|
37f3325b06
|
[router][grpc] Support E2E non-stream chat completions (#10980)
|
2025-09-26 22:02:06 -07:00 |
|
Muqi Li
|
bd95944cf6
|
[Bugfix][Minor][Benchmark] Fix some bugs due to PR #10495 (#10982)
|
2025-09-26 22:01:05 -07:00 |
|
hzh0425
|
c8a5d12abe
|
[HiCache]: Support dynamic loading backends for hicache (#10551)
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-26 18:34:11 -07:00 |
|
Xiaoyu Zhang
|
2387c22b56
|
Ci monitor support performance (#10965)
|
2025-09-27 09:11:21 +08:00 |
|
hlu1
|
592ddf374f
|
Add simple docker file for B300 (#10944)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-09-26 17:26:57 -07:00 |
|
Chang Su
|
0c3db88978
|
[router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971)
|
2025-09-26 20:10:45 -04:00 |
|
amysaq2023
|
2bdaf482f9
|
refactor loading weights from remote instance coding format (#10941)
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
|
2025-09-26 15:25:39 -07:00 |
|
Mick
|
777eb53897
|
ci: refactor nightly test (#10495)
|
2025-09-26 15:24:30 -07:00 |
|
Xiaoyu Zhang
|
05a3526654
|
Restruct gpu_memory_settings in a unify function and relax max_cuda_graph_bs (#10372)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
|
2025-09-26 15:10:49 -07:00 |
|
Lianmin Zheng
|
e56c64bfaf
|
Update label field comment to indicate deprecation (#10970)
|
2025-09-26 12:59:59 -07:00 |
|
Mick
|
fff7fbabe6
|
ci: fix rate-limit of huggingface with hf auth login (#10947)
|
2025-09-26 11:02:44 -07:00 |
|
Simo Lin
|
aae7ead2d0
|
[router] remove old/oudated/useless comments across code base (#10968)
|
2025-09-26 10:48:50 -07:00 |
|
Simo Lin
|
a7fe6e10a1
|
[router] remove old/oudated/useless comments (#10967)
|
2025-09-26 09:45:15 -07:00 |
|
Simo Lin
|
be059b83d6
|
[router] grpc router regular mode import cleanup (#10963)
|
2025-09-26 04:06:59 -07:00 |
|
Simo Lin
|
5d4fe1ceee
|
[router] add move grpc worker management from router to worker manager (#10960)
|
2025-09-26 03:57:57 -07:00 |
|
Simo Lin
|
1b011e68dc
|
[router] move grpc client from router to worker and builder (#10958)
|
2025-09-26 03:13:47 -07:00 |
|
Simo Lin
|
5c0efa562b
|
[router]fix code owner syntax error (#10956)
|
2025-09-26 03:07:18 -07:00 |
|
Simo Lin
|
1e57b9472d
|
[router] add grpc client get and set (#10955)
|
2025-09-26 03:07:05 -07:00 |
|