huangtingwei
|
26c8a310bd
|
fix incorrect increase of hit count (#8533)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 06:02:42 +00:00 |
|
yi wang
|
5963e50503
|
[bugfix] Fix 2 minor bugs in the hicache storage layer (#8404)
|
2025-07-31 05:47:14 +00:00 |
|
Yineng Zhang
|
43118f5f2a
|
chore: bump sgl-kernel v0.2.8 (#8599)
|
2025-07-30 22:23:52 -07:00 |
|
Cheng Wan
|
a5f5ab4030
|
update sgl-kernel for EP: kernel part (#8514)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2025-07-30 22:19:55 -07:00 |
|
Binyao Jiang
|
59aab76f0a
|
Bug: Fix google gemma3n-mm audio input not working bug (#8365)
|
2025-07-30 21:23:09 -07:00 |
|
Charles Chen
|
659bfd1023
|
Add GKE's default CUDA runtime lib location to PATH and LD_LIBRARY_PATH. (#8544)
|
2025-07-30 20:28:07 -07:00 |
|
Lifu Huang
|
67e53b16f5
|
Bump transfomers to 4.54.1 to fix Gemma cache issue. (#8541)
|
2025-07-30 19:50:54 -07:00 |
|
Qi Yuhang
|
9b9e82539b
|
[Fix]Fix index oob in get_group_gemm_starts kernel. (#8564)
|
2025-07-30 19:49:35 -07:00 |
|
Simo Lin
|
66a398f49d
|
[router] migrate router from actix to axum (#8479)
|
2025-07-30 17:47:19 -07:00 |
|
pansicheng
|
299803343d
|
Add hf3fs support for hicache storage (based on #7704) (#7280)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-30 17:42:41 -07:00 |
|
Chang Su
|
a79a5d7012
|
Revert "Fix the input tools format and history tool_calls in OpenAI API (#6556)" (#8584)
|
2025-07-30 13:12:05 -07:00 |
|
Adarsh Shirawalmath
|
ec5f944271
|
[Model] Add support for Arcee Foundational Model (#8154)
|
2025-07-30 10:45:25 -07:00 |
|
Yuan Luo
|
3bdcdd134b
|
[Hot-Fix] moe_aligned_block_size CI failed in AMD (#8461)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
|
2025-07-31 00:28:32 +08:00 |
|
Rui Chen
|
a730ce8162
|
[feature] [sgl-router] Add a dp-aware routing strategy (#6869)
|
2025-07-30 05:58:48 -07:00 |
|
Shangming Cai
|
55ecdc0a8e
|
Update CODEOWNERS (#8562)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
|
2025-07-30 01:05:57 -07:00 |
|
Elfie Guo
|
e3f08c77bc
|
Update cutlass_moe.py (#8545)
|
2025-07-29 23:46:34 -07:00 |
|
Simo Lin
|
a9fd80336d
|
[router] allow longer time out for router e2e (#8560)
|
2025-07-29 23:43:37 -07:00 |
|
hzh0425
|
2fbb754e1d
|
feature(pd-hicache): Prefill instances support reusing the RemoteStorage Cache via HiCache. (#8516)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-29 21:19:25 -07:00 |
|
hzh0425
|
a85ebf50b8
|
feat(hicache): support file backend reading directory config form env. (#8498)
|
2025-07-29 21:18:46 -07:00 |
|
Cheng Wan
|
9effeb5bdd
|
Support EPLB in FusedMoE (#8448)
|
2025-07-29 16:02:41 -07:00 |
|
Mick
|
1992ef9ba7
|
fix: temporarily disable cuda-ipc for mm data tensor (#8431)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-29 22:42:03 +00:00 |
|
Stefan He
|
c0fd77e839
|
bring back kimi vl ci (#8537)
|
2025-07-29 13:14:18 -07:00 |
|
Lianmin Zheng
|
a4c3b121d8
|
Split the scheduler into multiple mixin classes to reduce the file size (#8483)
|
2025-07-29 12:46:50 -07:00 |
|
Ke Bao
|
5973675bc3
|
Fix moe align kernel test (#8531)
|
2025-07-29 11:03:02 -07:00 |
|
Elfie Guo
|
4d16c88b6e
|
Update cutlass_moe.py (#8535)
|
2025-07-29 10:49:41 -07:00 |
|
Xiaoyu Zhang
|
7a4309cc8a
|
[sgl-kernel performace] fix fp8 quant kernels dispatch __nv_fp8_e4m3 bug to improve performance 10%-20% (#8499)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2025-07-29 23:31:54 +08:00 |
|
Lianmin Zheng
|
813670660c
|
Update README.md (#8528)
|
2025-07-29 04:09:19 -07:00 |
|
Lianmin Zheng
|
263c9236a0
|
Always trigger pr-test (#8527)
|
2025-07-29 04:05:19 -07:00 |
|
Yineng Zhang
|
6478831be9
|
chore: bump v0.4.9.post6 (#8517)
|
2025-07-29 02:30:07 -07:00 |
|
TimWang
|
2e1d2d7e66
|
Add PVC and update resource limits in k8s config (#8489)
|
2025-07-28 23:15:31 -07:00 |
|
Lifu Huang
|
fb16fbaf52
|
Fix incorrect KV cache allocation for MTP models. (#8482)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-07-28 22:54:50 -07:00 |
|
fzyzcjy
|
0ce84c822b
|
Support colocating requests (#7973)
|
2025-07-28 22:51:49 -07:00 |
|
fzyzcjy
|
59d0bf012f
|
Tiny add warnings for DeepEP when it is suboptimal (#8426)
|
2025-07-28 22:51:38 -07:00 |
|
fzyzcjy
|
7df2c0c2db
|
Reduce memory usage for fp4 moe (#8413)
|
2025-07-28 22:51:23 -07:00 |
|
Lianmin Zheng
|
69712e6f55
|
Rename the last step in pr-test.yml as pr-test-finish (#8486)
|
2025-07-28 19:06:13 -07:00 |
|
Lianmin Zheng
|
001bffca62
|
Update CODEOWNERS (#8485)
|
2025-07-28 17:57:23 -07:00 |
|
Keyang Ru
|
7c9697178e
|
[CI]Add genai-bench Performance Validation for PD Router (#8477)
Co-authored-by: key4ng <rukeyang@gamil.com>
|
2025-07-28 16:58:23 -07:00 |
|
Yineng Zhang
|
8240a6b013
|
chore: add glm 4.5 fp8 tp4 config (#8480)
|
2025-07-28 16:14:01 -07:00 |
|
Yineng Zhang
|
3a04aa4be7
|
chore: add glm4 fp8 tp8 config (#8478)
|
2025-07-28 16:08:53 -07:00 |
|
Lianmin Zheng
|
bd51694906
|
Update codeowner (#8476)
|
2025-07-28 16:03:49 -07:00 |
|
Stefan He
|
74e7e45710
|
Fix DEEPEP BF16 compatibility for Deepseek Style model like GLM 4.5 (#8469)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
|
2025-07-28 14:36:08 -07:00 |
|
Yineng Zhang
|
1466c1b896
|
feat: support glm4 tuning (#8473)
|
2025-07-28 14:32:58 -07:00 |
|
Cheng Wan
|
9c138a0445
|
[3/N] MoE Refactor: Simplify DeepEP Output (#8421)
|
2025-07-28 11:37:17 -07:00 |
|
Timofey
|
c8f549d96d
|
Fix parsing ChatCompletionMessage (#7273)
Co-authored-by: Timofey K <timosha1113@gmail.com>
|
2025-07-28 11:35:14 -07:00 |
|
Kaixi Hou
|
134fa43e19
|
[NVIDIA] Change to use num_local_experts (#8453)
|
2025-07-28 10:38:19 -07:00 |
|
Yineng Zhang
|
ccfe52a057
|
fix: update dep (#8467)
|
2025-07-28 10:19:33 -07:00 |
|
harrisonlimh
|
747dd45077
|
feat: throttle requests at scheduler based on --max_queued_requests (#7565)
|
2025-07-28 22:32:33 +08:00 |
|
Ke Bao
|
b582159246
|
Update PR template (#8465)
|
2025-07-28 22:12:36 +08:00 |
|
erictanjn
|
a9dd3ec3e9
|
fix:reorder topk experts to ensure shared expert replaces minimal score (#8125)
|
2025-07-28 20:36:46 +08:00 |
|
Yineng Zhang
|
45bc170b36
|
chore: bump v0.4.9.post5 (#8458)
|
2025-07-28 02:11:06 -07:00 |
|