maxiao1
7993ed8ddd
适配deepseekv3.2
CI Monitor / ci-monitor (push) Has been cancelled
Release Docker Images Nightly (AMD) / publish (all, gfx942) (push) Has been cancelled
Release Docker Images Nightly (AMD) / publish (all, gfx942-rocm700) (push) Has been cancelled
Release Docker Images Nightly (AMD) / publish (all, gfx950) (push) Has been cancelled
Release Docker Images Nightly (AMD) / publish (srt, gfx942) (push) Has been cancelled
Release Docker Images Nightly (AMD) / publish (srt, gfx942-rocm700) (push) Has been cancelled
Release Docker Images Nightly (AMD) / publish (srt, gfx950) (push) Has been cancelled
Release Docker Images Nightly (Ascend NPU) / build (8.2.rc1, 910b) (push) Has been cancelled
Release Docker Images Nightly (Ascend NPU) / build (8.2.rc1, a3) (push) Has been cancelled
Build and Push Development Docker Images / build-dev-x86 (map[tag:dev type:all version:12.9.1]) (push) Has been cancelled
Build and Push Development Docker Images / build-blackwell-arm (map[tag:blackwell-cu129 type:blackwell_aarch version:12.9.1]) (push) Has been cancelled
Build and Push Development Docker Images / create-manifests (map[arm64_tag:blackwell-cu129-arm64 tag:dev-manifest x86_tag:dev]) (push) Has been cancelled
Nightly Test / nightly-test-eval-text-models (push) Has been cancelled
Nightly Test / nightly-test-perf-text-models (push) Has been cancelled
Nightly Test / nightly-test-eval-vlms (push) Has been cancelled
Nightly Test / nightly-test-perf-vlms (push) Has been cancelled
Nightly Test (AMD) / nightly-test (linux-mi300-gpu-2) (push) Has been cancelled
Nightly Test (AMD) / nightly-test (linux-mi325-gpu-2-nightly) (push) Has been cancelled
Close Inactive Issues / close-inactive-issues (push) Has been cancelled
2025-10-03 20:01:17 +08:00
maxiao1
443a1b4ab3
Update pyproject_other.toml
2025-09-30 10:47:20 +00:00
maxiao
852a49c5cc
adapt to dsv32 on dcu
2025-09-30 18:37:31 +08:00
maxiao
8f7453e3af
adapt to ds3.2
2025-09-30 17:44:54 +08:00
Lianmin Zheng
1237aa19ce
[Auto Sync] Update fused_moe_triton_config.py (20250930) ( #11099 )
...
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
2025-09-30 00:57:16 -07:00
jacky.cheng
5991119541
[Fix] Resolve performance drop in speculative decoding aiter backend ( #11087 )
2025-09-29 23:51:30 -07:00
Ke Bao
424591d53d
Fix spec filter batch when target extend ( #10991 )
2025-09-30 14:44:02 +08:00
Chang Su
d1676cd483
[router][tool call] Full support for ToolChoice ( #11085 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-09-29 22:36:03 -07:00
Simo Lin
33b3c0f85f
[router] grpc router generate endpoint support ( #11070 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-09-29 22:07:53 -07:00
Lianmin Zheng
e5281f84d5
Update CODEOWNERS for attention/ascend_backend.py ( #11092 )
2025-09-29 21:28:49 -07:00
narutolhy
d17986f8c6
Enable optional FP32 compute for LM Head ( #10729 )
...
Thanks to MiniMax Team and Chenyang Zhao's support.
2025-09-29 20:45:17 -07:00
DevashishLal-CB
8831c55c3d
[model] added support for w8a8int8 used by neuralmagic/Qwen2-0.5B-Ins… ( #9642 )
2025-09-30 11:26:17 +08:00
li-kesen
2bc61dd194
Remove hybrid_linear_attn attention backend and refactor attention registry ( #10816 )
...
Co-authored-by: Yi Zhang <1109276519@qq.com >
2025-09-30 10:16:16 +08:00
Cheng Wan
6535fda127
[Profile] dump memory trace when cuda graph profile is enabled ( #11083 )
2025-09-29 17:36:48 -07:00
Jimmy
3713eb6135
feat(reasoning): improve enable thinking from request ( #10875 )
2025-09-29 16:59:08 -07:00
Chang Su
5937a56d47
[router][grpc] Add logprobs support to router ( #11082 )
2025-09-29 15:55:06 -07:00
Chang Su
f065e5bea5
[router] Use get_pooled in process_single_choice ( #11079 )
2025-09-29 15:48:00 -07:00
Mick
9de1320b63
fix: fp8 mllama4 without vision modules being quantized ( #10611 )
2025-09-29 21:17:12 +00:00
Lianmin Zheng
dda34c2f93
Fix mem fraction static for nightly tests ( #11076 )
2025-09-29 12:57:41 -07:00
Chang Su
4eeaff74a0
[router][tool call] Separate JsonParser and LlamaParser ( #11073 )
2025-09-29 10:26:37 -07:00
Lianmin Zheng
a17e70f5cc
Use more general heuristics to set the default value of --mem-fraction-static ( #10975 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-09-29 10:11:03 -07:00
Simo Lin
816b3a433a
[router] add n to generate sampling params ( #11069 )
2025-09-29 07:37:43 -07:00
Yineng Zhang
3a641d9085
chore: upgrade sgl-kernel 0.3.13 ( #11056 )
2025-09-29 02:22:25 -07:00
Xiaoyu Zhang
6f16bf9d9d
[Ci Monitor] Auto uploaded performance data to sglang_ci_data repo ( #10976 )
2025-09-29 16:17:27 +08:00
Yineng Zhang
5942fdb480
chore: upgrade cutedsl 4.2.1 ( #11054 )
2025-09-29 00:24:17 -07:00
Chang Su
af4ab65606
[router][tool call] Improve normal content extraction and error handling (non-stream) ( #11050 )
2025-09-29 00:19:30 -07:00
Xiaoyu Zhang
11965b0daf
Fix sgl-kernel benchmark dead code ( #11022 )
2025-09-29 15:06:40 +08:00
Vincent Zhong
71959545df
Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' ( #9614 )
2025-09-29 06:18:29 +00:00
Zhihao Zhang
24f7cb1ece
[speculative decoding] rename lookahead to ngram ( #11010 )
...
Co-authored-by: a4zhangfei <a4zhangfei@qq.com >
2025-09-28 21:06:59 -07:00
huangtingwei
e05555fad8
[HiCacheStorage] mooncake store support page_first_direct layout ( #10591 )
2025-09-28 20:45:48 -07:00
Mick
43fa9f22bd
fix: check if weights are already local before downloading ( #11015 )
2025-09-28 20:11:33 -07:00
Lifu Huang
e98d9346c7
[1/2] Support FA4 for MHA Prefill in sgl-kernel ( #10940 )
2025-09-28 19:59:14 -07:00
Kangyan-Zhou
0c9174108a
Unify SGL Kernel Releases ( #10701 )
2025-09-28 19:48:28 -07:00
Simo Lin
2572886367
[router] add harmony tool parser base structure and interface ( #11036 )
2025-09-28 19:46:38 -07:00
Chang Su
dba751a896
[router][tool call] Support normal content extraction before tool call (streaming) ( #11038 )
2025-09-28 19:46:06 -07:00
Mick
2e7633982c
fix: show failed models in nightly ci ( #10986 )
2025-09-28 12:38:29 -07:00
Simo Lin
336e9a6058
[router] migrate to rust python module for pythonic parser ( #11033 )
2025-09-28 14:48:59 -04:00
Yuxuan Zhang
abb6781573
Update GLM-4.5 Model Doc ( #11017 )
2025-09-28 11:21:27 -07:00
Lianmin Zheng
07440f5f34
Fix FusedSetKVBufferArg in RotaryEmbedding ( #11003 )
2025-09-28 11:17:27 -07:00
Teng Ma
9816989bff
[HiCache] bug: fix mooncake store batch set v1 ( #11013 )
2025-09-28 23:18:48 +08:00
Yuan Luo
42245551ef
[sgl-kernel] Optimize concat_mla_k kernel ( #10543 )
...
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com >
Co-authored-by: PGFLMG <1106310035@qq.com >
2025-09-28 23:04:22 +08:00
lbk-sys
2a9d995c09
prepare for sglang+verl ( #10555 )
...
Signed-off-by: lbk-sys <hello_lbk@163.com >
Signed-off-by: libaokui <libaokui@hauwei.com >
Co-authored-by: libaokui <libaokui@hauwei.com >
Co-authored-by: Even Zhou <even.y.zhou@outlook.com >
2025-09-28 01:39:17 -07:00
wejoncy
a9050b5c39
[bugfix]Add empty_context import to two_batch_overlap.py ( #10964 )
2025-09-28 01:26:20 -07:00
YanbingJiang
66face3598
Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' ( #11009 )
2025-09-28 00:31:08 -07:00
Simo Lin
5519766a4d
[router] fix chat template loading and tokenizer path ( #10999 )
2025-09-27 23:54:12 -04:00
Keyang Ru
72392f2908
[router] basic mcp support for openai router response api ( #10978 )
2025-09-27 21:49:33 -04:00
Chang Su
c1c8dd1dd0
[router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) ( #10995 )
2025-09-27 18:10:17 -04:00
Lianmin Zheng
f6bc3f529b
Fix profiler ( #10997 )
2025-09-27 14:56:18 -07:00
Tejesh Anand
8cc27fdc46
Use jsonschema to constrain required or specific tool choice ( #10550 )
2025-09-27 13:18:50 -04:00
Shangming Cai
9c339d6b47
[PD] Extract the PP transfer layer calculate logic from Mooncake to Common backend ( #10565 )
...
Signed-off-by: Shangming Cai <csmthu@gmail.com >
2025-09-28 00:10:41 +08:00
