fzyzcjy
|
2f80bd9f0e
|
Bump torch_memory_saver 0.0.9rc2 (#11252)
|
2025-10-05 20:26:20 -07:00 |
|
Lianmin Zheng
|
366a603e95
|
Use cu128 for torch audio to fix some CI tests (#11251)
|
2025-10-05 19:52:32 -07:00 |
|
Bowen Bao
|
baee08601b
|
[quantization] Enable aiter mxfp4 fused_moe for Quark (#10048)
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2025-10-05 19:51:34 -07:00 |
|
Bowen Bao
|
c7a104c12b
|
[quantization] Fix scale remapping for mllama4 (#10042)
Co-authored-by: HAI <hixiao@gmail.com>
|
2025-10-05 19:51:15 -07:00 |
|
Mick
|
97d966a7f8
|
ci: make find_local_hf_snapshot_dir more robust (#11248)
|
2025-10-05 19:50:11 -07:00 |
|
sglang-bot
|
8e66d87f0a
|
Fix spec_utils.py (#11247)
|
2025-10-05 19:01:11 -07:00 |
|
Kangyan-Zhou
|
a20fc7b7dc
|
Create two new GH workflows to automatically bump SGLang and Kernel version (#10996)
|
2025-10-05 18:14:05 -07:00 |
|
Lianmin Zheng
|
6b30e097ab
|
[Auto Sync] Update io_struct.py (20251004) (#11206)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
|
2025-10-05 18:06:07 -07:00 |
|
Lianmin Zheng
|
d645ae90a3
|
Rename runner labels (#11228)
|
2025-10-05 18:05:41 -07:00 |
|
Cheng Wan
|
41763ba079
|
Remove gdrcopy check in ci_install_deepep.sh (#11237)
|
2025-10-05 17:35:22 -07:00 |
|
Xinyuan Tong
|
652c24a653
|
Update transformers package version to 4.57.0 (#11222)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
|
2025-10-05 23:45:14 +00:00 |
|
sunxxuns
|
5e142484e2
|
[Fix AMD CI] VRAM cleanup (#11174)
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
|
2025-10-05 19:03:53 -04:00 |
|
Shangming Cai
|
c560410da7
|
Refactor and optimize mooncake CI (#11162)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-05 14:08:52 -07:00 |
|
Yuan Luo
|
590f2da052
|
[Feat] Support Torch Symm Mem AllReduce (#10571)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-10-05 13:55:19 -07:00 |
|
Lianmin Zheng
|
148d8d485d
|
Update DeepGEMM repository tag to specific commit (#11229)
|
2025-10-05 13:47:36 -07:00 |
|
PGFLMG
|
1a599509cc
|
chore: bump sgl-kernel v0.3.14.post1 (#11137)
|
2025-10-05 13:46:43 -07:00 |
|
Vincent Zhong
|
36a6b8dbfc
|
Update v1/responses to be more OpenAI-compatible. (#9624)
|
2025-10-05 18:47:46 +00:00 |
|
DarkSharpness
|
e0b2d3eebe
|
[Feature] Add a fast-topk to sgl-kernel for DeepSeek v3.2 (#11194)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-05 10:19:03 -07:00 |
|
Liangsheng Yin
|
4cb5a5235e
|
Tiny skip_sample adjust (#11225)
|
2025-10-05 23:41:04 +08:00 |
|
Xu Wenqing
|
85c1f79377
|
Add DeepSeek-V3.2 Tool Call Template (#11063)
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
|
2025-10-04 18:53:49 -07:00 |
|
yhyang201
|
48e9e71930
|
Add --max-new-tokens CLI flag for MMMU evaluation (#11217)
|
2025-10-04 17:35:53 -07:00 |
|
Ke Bao
|
31b49c0b51
|
EAGLE cache fix for HiCache (#11215)
|
2025-10-04 16:53:53 -07:00 |
|
Simo Lin
|
d736e0b65e
|
[router] add grpc router pd mode for chat and generate (#11140)
|
2025-10-04 06:58:28 -07:00 |
|
Simo Lin
|
ffd03a9bd3
|
[router] fix get load response parsing (#11213)
|
2025-10-04 06:58:02 -07:00 |
|
Hank Han
|
666da3d59f
|
[fix]enable flashmla when using draft model P/D attention select (#11012)
|
2025-10-04 20:59:34 +08:00 |
|
Alex Chi Z
|
d01b921482
|
fix sampling_seed handling when deterministic is enabled (#11096)
Signed-off-by: Alex Chi <iskyzh@gmail.com>
|
2025-10-03 20:41:46 -07:00 |
|
hzh0425
|
c70e58e837
|
[HICache]: Refactor HiCache CI (#11011)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-03 20:51:56 -04:00 |
|
narutolhy
|
c61b9a1d01
|
fix self.enable_kv_cache_events (#11178)
|
2025-10-03 14:09:41 -07:00 |
|
Hank Han
|
3c3d6255d9
|
[fix]missing prefix_lens_cpu init when p/d disaggregation (#11196)
|
2025-10-03 13:39:59 -07:00 |
|
XSongQ
|
546914fa2d
|
[Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in data_parallel_controller.py (#10741)
|
2025-10-03 13:25:57 -07:00 |
|
Liangsheng Yin
|
4726c9197f
|
[minor] fix the lint (#11198)
|
2025-10-04 01:04:58 +08:00 |
|
jiapingW
|
a0010bf4e8
|
fix qwen2 eagle3 runtime error (#10517)
|
2025-10-04 00:19:52 +08:00 |
|
DiweiSun
|
307fc060e8
|
fix xeon ci check (#10838)
|
2025-10-04 00:17:36 +08:00 |
|
vikram singh shekhawat
|
586e81a28a
|
[Test] Initialize mem_fraction_static in setUpClass to fix pytest VLM test crashes. (#10859)
Co-authored-by: svc_repro_tool <svc_repro_tool@habana.ai>
|
2025-10-04 00:14:48 +08:00 |
|
Praneth Paruchuri
|
fad7ca73f8
|
model: support starcoder2 (#10609)
|
2025-10-04 00:11:19 +08:00 |
|
pansicheng
|
08af8ffb5c
|
fix 3fs indices (#10855)
|
2025-10-04 00:06:38 +08:00 |
|
Shangming Cai
|
2c7f4ca2f2
|
Optimize debug log position of PD abort request (#11090)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-03 23:07:02 +08:00 |
|
shubham singhal
|
03def5e3b1
|
Fix [test]: Env:SGLANG_TORCH_PROFILER_DIR for pytest. (#10780)
|
2025-10-03 22:59:32 +08:00 |
|
ur4t
|
6ae3f05b33
|
Fix CUDA illegal memory access issues in speculative decoding (#10892)
|
2025-10-03 22:44:07 +08:00 |
|
fzyzcjy
|
fdc4e1e570
|
Tiny move files to utils folder (#11166)
|
2025-10-03 22:40:06 +08:00 |
|
Liangsheng Yin
|
04b86b3c5c
|
[hot-fix] Fix CI break which caused by adding thinking_mode in eval (#11192)
|
2025-10-03 18:29:27 +08:00 |
|
hlu1
|
d6777a706d
|
Add --thinking-mode to run_eval (#11189)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-10-03 16:49:39 +08:00 |
|
Matt Nappo
|
8c57490210
|
[Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873)
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
|
2025-10-03 16:48:19 +08:00 |
|
Keyang Ru
|
34151f173b
|
[router] Steaming support for MCP Tool Calls in OpenAI Router (#11173)
|
2025-10-03 00:19:43 -07:00 |
|
fzyzcjy
|
6794d21051
|
Tiny add PD disaggregation + DP attention test (#11167)
|
2025-10-03 14:15:46 +08:00 |
|
Alex Chi Z
|
1a31229cd4
|
fix: radix cache memory accounting (#10637)
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
|
2025-10-02 22:47:33 -07:00 |
|
Liangsheng Yin
|
de89ef49da
|
[CI]] Tee server logs to both file and stdout/stderr using PIPE (#11185)
|
2025-10-03 12:31:13 +08:00 |
|
jacky.cheng
|
b00a0c786f
|
[Fix] Update to v0.1.5.post4 and refine HIP attention backend selection (#11161)
|
2025-10-02 21:19:30 -07:00 |
|
b8zhong
|
a2faf8940c
|
[1/n] Enable DCA CUDA graph capture (#9537)
|
2025-10-03 11:30:00 +08:00 |
|
Vedant V Jhaveri
|
7e61737d3f
|
[Generative Scores API] add performance tests to CICD (#10830)
|
2025-10-02 19:57:55 -07:00 |
|