Simo Lin
|
d511b2d905
|
[router] consolidate worker load monitoring (#10894)
|
2025-09-25 09:59:30 -04:00 |
|
lukec
|
77830a265e
|
Add fuse_moe per-channel tune (#10915)
|
2025-09-25 21:12:09 +08:00 |
|
yi wang
|
fce170480a
|
integrate AIBrix KVcache (#10376)
|
2025-09-25 14:47:09 +08:00 |
|
Zhiqiang Xie
|
3d40794fcf
|
[HiCache] Cleaning the deprecated host memory state (#10778)
|
2025-09-25 14:43:53 +08:00 |
|
Xiaoyu Zhang
|
c1f39013b7
|
[ci feature] add ci monitor (#10872)
|
2025-09-24 23:16:29 -07:00 |
|
Lianmin Zheng
|
3e43eb137b
|
[Auto Sync] Update model_config.py (20250925) (#10885)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-09-24 22:59:16 -07:00 |
|
Simo Lin
|
458c0219a6
|
[router] simplify tokenizer dev doc (#10895)
|
2025-09-24 22:15:56 -07:00 |
|
Keyang Ru
|
a73eb8cd20
|
[router] Support Oracle DB(ATP) Data Connector (#10845)
|
2025-09-24 23:59:32 -04:00 |
|
Simo Lin
|
e738703547
|
[router] consolidate worker get loads (#10880)
|
2025-09-24 22:13:31 -04:00 |
|
Yuhao Yao
|
fe531d6f4e
|
[Bug] Fix Issue#10215 (#10572)
|
2025-09-25 09:51:50 +08:00 |
|
Xiaoyu Zhang
|
c4e314f986
|
Restruct sgl-kernel benchmark (#10861)
|
2025-09-25 07:45:25 +08:00 |
|
Simo Lin
|
7a06ef984d
|
[router] consolidate health endpoints and flush cache (#10876)
|
2025-09-24 15:23:21 -07:00 |
|
Chang Su
|
4a87ba217f
|
router-grpc: Add tools processing and other paramters for apply_chat_template (#10877)
|
2025-09-24 15:23:06 -07:00 |
|
kushanam
|
d7b20dd65d
|
chore: Initial support for input config files (#10534)
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-24 14:45:52 -07:00 |
|
luna
|
c3faf2d6e6
|
[router] select first healthy worker on proxied get requests (#10827)
|
2025-09-24 11:45:41 -07:00 |
|
Chang Su
|
9209b209be
|
router-grpc: Support jinja chat template content format detection (#10832)
|
2025-09-24 11:45:01 -07:00 |
|
ishandhanani
|
adba172fd1
|
ci: free space on workers for build (#10786)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-09-24 02:58:22 -07:00 |
|
GuoweiWangU
|
cd641a995c
|
fix bailing_moe with enable_dp_attention (#10860)
|
2025-09-24 02:29:32 -07:00 |
|
Xinyuan Tong
|
71f24ef8f6
|
feat: add cache_salt support to request (#10718)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-09-23 23:30:25 -07:00 |
|
Lianmin Zheng
|
b1f0fc1c0b
|
Add CI timeout guidelines (#10829)
|
2025-09-23 22:08:02 -07:00 |
|
Lianmin Zheng
|
32d893730f
|
Revert "[fix][pd-disag]no need set next batch sampling info done in prefill" (#10828)
|
2025-09-23 17:02:01 -07:00 |
|
Lianmin Zheng
|
f47a2c67e6
|
[Auto Sync] Update load_config.py, model_config.py, configu... (20250923) (#10825)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-23 16:48:12 -07:00 |
|
Chang Su
|
ee704e6265
|
[router] add auth middleware for api key auth (#10826)
|
2025-09-23 16:07:34 -07:00 |
|
Keyang Ru
|
f4e3ebeb05
|
[router] Support streaming for Openai Router Response api (#10822)
|
2025-09-23 14:56:28 -07:00 |
|
Lianmin Zheng
|
312bfc4c95
|
[Auto Sync] Update simple_eval_common.py (20250923) (#10824)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2025-09-23 13:50:47 -07:00 |
|
Lianmin Zheng
|
e290303ea1
|
[Auto Sync] Update elementwise.py (20250923) (#10823)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-09-23 13:50:22 -07:00 |
|
Xinyuan Tong
|
aab35bccb4
|
fix: draft model IMA by overide max_positional_embeddings (#10787)
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
|
2025-09-23 12:56:16 -07:00 |
|
Yineng Zhang
|
42aedb02af
|
[Auto Sync] Update protocol.py (20250923) (#10820)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
|
2025-09-23 12:49:56 -07:00 |
|
Yiakwy
|
984730b732
|
add tunning files for QWEN-3-NEXT (#10794)
|
2025-09-23 12:46:30 -07:00 |
|
Shangming Cai
|
23632d350c
|
Fix latest main ci (#10799)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-23 12:46:13 -07:00 |
|
Chang Su
|
08b8c0c3cd
|
[router] fix axum default body limit (#10818)
|
2025-09-23 12:44:17 -07:00 |
|
Lzhang-hub
|
d42975c641
|
Remove duplicate code in qwen2 model (#10540)
|
2025-09-24 02:40:51 +08:00 |
|
ZhengHSI
|
adc24a3a0c
|
fix ceval (#10504)
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
|
2025-09-24 02:35:25 +08:00 |
|
Chang Su
|
7ff93e613f
|
router(grpc): Implement route for chat_cmpl endpoint (#10761)
|
2025-09-23 11:26:33 -07:00 |
|
Simo Lin
|
b24b2e7ed7
|
[router] use dashmap for radix tree instead of hash for multi model (#10814)
|
2025-09-23 11:25:53 -07:00 |
|
sogalin
|
7135db5d31
|
[ROCm] Update aiter to v0.1.5.post3 (#10812)
|
2025-09-23 10:54:12 -07:00 |
|
Jimmy
|
4b5ef3002c
|
[fix][pd-disag]no need set next batch sampling info done in prefill (#10259)
|
2025-09-24 01:24:36 +08:00 |
|
Zheng Li
|
4f564b9e83
|
model: support qwen3-vl series (#10323)
Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-23 10:15:52 -07:00 |
|
Simo Lin
|
98c3b04ff2
|
[router] responses api POST and GET with local storage (#10581)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-09-23 09:12:02 -07:00 |
|
Simo Lin
|
ddab4fc7c7
|
[router] fix cache aware routing strategy and lock contention (#10773)
|
2025-09-23 08:53:49 -07:00 |
|
Shangming Cai
|
d21c35224d
|
Fix hicache mooncake backend CI (#10792)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-23 02:04:44 -07:00 |
|
Liangsheng Yin
|
4a762041d7
|
move environ into sglang.srt to avoid break SRT auto sync. (#10791)
|
2025-09-23 02:04:20 -07:00 |
|
Lianmin Zheng
|
ea338676b5
|
Clean up server args (#10770)
|
2025-09-23 00:22:32 -07:00 |
|
ishandhanani
|
b06db198ba
|
followup: clean up dockerfiles and release yamls (#10783)
|
2025-09-23 00:19:46 -07:00 |
|
Yineng Zhang
|
8c1ef0f914
|
chore: upgrade sgl-kernel 0.3.12 (#10782)
|
2025-09-23 00:18:54 -07:00 |
|
Liangsheng Yin
|
f5a2faf2b8
|
Introduce FutureMap (#10715)
|
2025-09-22 23:27:30 -07:00 |
|
ishandhanani
|
1c82d9db28
|
feat: unify dockerfiles (#10705)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-22 23:23:48 -07:00 |
|
Lifu Huang
|
9241f4fd20
|
Move cached kernel to srt.utils (#10776)
|
2025-09-22 23:00:36 -07:00 |
|
fzyzcjy
|
063c3791fe
|
Fix trtllm_mla slow concat kernel in MTP (#10777)
|
2025-09-22 22:47:49 -07:00 |
|
Liangsheng Yin
|
632b7d8cc9
|
Use simulate acc len from sglang.environ (#10771)
|
2025-09-23 12:59:50 +08:00 |
|