Xinyuan Tong
|
a9ce2bcb3c
|
[Doc] Update multimodal language models documentation (#11111)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-09-30 22:10:31 -07:00 |
|
Lianmin Zheng
|
5dddb331c4
|
[Auto Sync] Update base_grammar_backend.py, xgrammar_backen... (20250930) (#11115)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
|
2025-09-30 21:50:43 -07:00 |
|
Hubert Lu
|
01a26544a3
|
[AMD] Add Tilelang and Fast Hadamard Transform builds to Dockerfile.rocm (#11114)
|
2025-09-30 20:00:37 -07:00 |
|
Liangsheng Yin
|
73d4a5f879
|
Organize spec-related data structures (#10735)
|
2025-10-01 09:45:30 +08:00 |
|
Keyang Ru
|
7fb551a75d
|
[router] add mcp list and mcp call in output array (#11112)
|
2025-09-30 21:41:54 -04:00 |
|
Xinyuan Tong
|
1193f13181
|
fix: KimiK2Detector Improve tool call ID parsing with regex (#10972)
|
2025-09-30 17:44:44 -07:00 |
|
Chenxi Li
|
84a9f5d660
|
Feature/make PEFT adapter module format compatibile (#11080)
|
2025-09-30 16:32:02 -07:00 |
|
Chang Su
|
8ce830a8b0
|
[router][bugfix] Fix input_logprobs handling with None value and logprob_start_len = -1 (#11113)
|
2025-09-30 16:09:40 -07:00 |
|
qrskannbara
|
fb367acfcb
|
Support Dots.ocr model (#11071)
|
2025-09-30 12:18:39 -07:00 |
|
Trevor Morris
|
a6cc86df9d
|
Fix DSR1 accuracy for flashinfer_trtllm MoE with FP8 quantization (#11081)
|
2025-09-30 10:33:12 -07:00 |
|
Zaili Wang
|
229d2b95f1
|
[CPU] Adding Memory Capacity Acquisition Functionality (#11102)
|
2025-09-30 08:41:20 -07:00 |
|
Liangsheng Yin
|
9710f718fb
|
[Eval] Add --repeat in run_eval (#11101)
|
2025-09-30 23:35:54 +08:00 |
|
Ke Bao
|
91847e382a
|
Fix eagle radix cache (#10846)
|
2025-09-30 22:59:20 +08:00 |
|
Simo Lin
|
5a290a5644
|
[router][grpc-server] Fix gRPC server shutdown (#11094)
|
2025-09-30 07:12:12 -04:00 |
|
PGFLMG
|
580051c5a8
|
chore: bump sgl-kernel v0.3.14 (#11067)
|
2025-09-30 02:53:24 -07:00 |
|
Lianmin Zheng
|
1237aa19ce
|
[Auto Sync] Update fused_moe_triton_config.py (20250930) (#11099)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-09-30 00:57:16 -07:00 |
|
jacky.cheng
|
5991119541
|
[Fix] Resolve performance drop in speculative decoding aiter backend (#11087)
|
2025-09-29 23:51:30 -07:00 |
|
Ke Bao
|
424591d53d
|
Fix spec filter batch when target extend (#10991)
|
2025-09-30 14:44:02 +08:00 |
|
Chang Su
|
d1676cd483
|
[router][tool call] Full support for ToolChoice (#11085)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-09-29 22:36:03 -07:00 |
|
Simo Lin
|
33b3c0f85f
|
[router] grpc router generate endpoint support (#11070)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-09-29 22:07:53 -07:00 |
|
Lianmin Zheng
|
e5281f84d5
|
Update CODEOWNERS for attention/ascend_backend.py (#11092)
|
2025-09-29 21:28:49 -07:00 |
|
narutolhy
|
d17986f8c6
|
Enable optional FP32 compute for LM Head (#10729)
Thanks to MiniMax Team and Chenyang Zhao's support.
|
2025-09-29 20:45:17 -07:00 |
|
DevashishLal-CB
|
8831c55c3d
|
[model] added support for w8a8int8 used by neuralmagic/Qwen2-0.5B-Ins… (#9642)
|
2025-09-30 11:26:17 +08:00 |
|
li-kesen
|
2bc61dd194
|
Remove hybrid_linear_attn attention backend and refactor attention registry (#10816)
Co-authored-by: Yi Zhang <1109276519@qq.com>
|
2025-09-30 10:16:16 +08:00 |
|
Cheng Wan
|
6535fda127
|
[Profile] dump memory trace when cuda graph profile is enabled (#11083)
|
2025-09-29 17:36:48 -07:00 |
|
Jimmy
|
3713eb6135
|
feat(reasoning): improve enable thinking from request (#10875)
|
2025-09-29 16:59:08 -07:00 |
|
Chang Su
|
5937a56d47
|
[router][grpc] Add logprobs support to router (#11082)
|
2025-09-29 15:55:06 -07:00 |
|
Chang Su
|
f065e5bea5
|
[router] Use get_pooled in process_single_choice (#11079)
|
2025-09-29 15:48:00 -07:00 |
|
Mick
|
9de1320b63
|
fix: fp8 mllama4 without vision modules being quantized (#10611)
|
2025-09-29 21:17:12 +00:00 |
|
Lianmin Zheng
|
dda34c2f93
|
Fix mem fraction static for nightly tests (#11076)
|
2025-09-29 12:57:41 -07:00 |
|
Chang Su
|
4eeaff74a0
|
[router][tool call] Separate JsonParser and LlamaParser (#11073)
|
2025-09-29 10:26:37 -07:00 |
|
Lianmin Zheng
|
a17e70f5cc
|
Use more general heuristics to set the default value of --mem-fraction-static (#10975)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
|
2025-09-29 10:11:03 -07:00 |
|
Simo Lin
|
816b3a433a
|
[router] add n to generate sampling params (#11069)
|
2025-09-29 07:37:43 -07:00 |
|
Yineng Zhang
|
3a641d9085
|
chore: upgrade sgl-kernel 0.3.13 (#11056)
|
2025-09-29 02:22:25 -07:00 |
|
Xiaoyu Zhang
|
6f16bf9d9d
|
[Ci Monitor] Auto uploaded performance data to sglang_ci_data repo (#10976)
|
2025-09-29 16:17:27 +08:00 |
|
Yineng Zhang
|
5942fdb480
|
chore: upgrade cutedsl 4.2.1 (#11054)
|
2025-09-29 00:24:17 -07:00 |
|
Chang Su
|
af4ab65606
|
[router][tool call] Improve normal content extraction and error handling (non-stream) (#11050)
|
2025-09-29 00:19:30 -07:00 |
|
Xiaoyu Zhang
|
11965b0daf
|
Fix sgl-kernel benchmark dead code (#11022)
|
2025-09-29 15:06:40 +08:00 |
|
Vincent Zhong
|
71959545df
|
Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614)
|
2025-09-29 06:18:29 +00:00 |
|
Zhihao Zhang
|
24f7cb1ece
|
[speculative decoding] rename lookahead to ngram (#11010)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-09-28 21:06:59 -07:00 |
|
huangtingwei
|
e05555fad8
|
[HiCacheStorage] mooncake store support page_first_direct layout (#10591)
|
2025-09-28 20:45:48 -07:00 |
|
Mick
|
43fa9f22bd
|
fix: check if weights are already local before downloading (#11015)
|
2025-09-28 20:11:33 -07:00 |
|
Lifu Huang
|
e98d9346c7
|
[1/2] Support FA4 for MHA Prefill in sgl-kernel (#10940)
|
2025-09-28 19:59:14 -07:00 |
|
Kangyan-Zhou
|
0c9174108a
|
Unify SGL Kernel Releases (#10701)
|
2025-09-28 19:48:28 -07:00 |
|
Simo Lin
|
2572886367
|
[router] add harmony tool parser base structure and interface (#11036)
|
2025-09-28 19:46:38 -07:00 |
|
Chang Su
|
dba751a896
|
[router][tool call] Support normal content extraction before tool call (streaming) (#11038)
|
2025-09-28 19:46:06 -07:00 |
|
Mick
|
2e7633982c
|
fix: show failed models in nightly ci (#10986)
|
2025-09-28 12:38:29 -07:00 |
|
Simo Lin
|
336e9a6058
|
[router] migrate to rust python module for pythonic parser (#11033)
|
2025-09-28 14:48:59 -04:00 |
|
Yuxuan Zhang
|
abb6781573
|
Update GLM-4.5 Model Doc (#11017)
|
2025-09-28 11:21:27 -07:00 |
|
Lianmin Zheng
|
07440f5f34
|
Fix FusedSetKVBufferArg in RotaryEmbedding (#11003)
|
2025-09-28 11:17:27 -07:00 |
|