Stefan He
|
c0fd77e839
|
bring back kimi vl ci (#8537)
|
2025-07-29 13:14:18 -07:00 |
|
Lianmin Zheng
|
a4c3b121d8
|
Split the scheduler into multiple mixin classes to reduce the file size (#8483)
|
2025-07-29 12:46:50 -07:00 |
|
Ke Bao
|
5973675bc3
|
Fix moe align kernel test (#8531)
|
2025-07-29 11:03:02 -07:00 |
|
Elfie Guo
|
4d16c88b6e
|
Update cutlass_moe.py (#8535)
|
2025-07-29 10:49:41 -07:00 |
|
Xiaoyu Zhang
|
7a4309cc8a
|
[sgl-kernel performace] fix fp8 quant kernels dispatch __nv_fp8_e4m3 bug to improve performance 10%-20% (#8499)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2025-07-29 23:31:54 +08:00 |
|
Lianmin Zheng
|
813670660c
|
Update README.md (#8528)
|
2025-07-29 04:09:19 -07:00 |
|
Lianmin Zheng
|
263c9236a0
|
Always trigger pr-test (#8527)
|
2025-07-29 04:05:19 -07:00 |
|
Yineng Zhang
|
6478831be9
|
chore: bump v0.4.9.post6 (#8517)
|
2025-07-29 02:30:07 -07:00 |
|
TimWang
|
2e1d2d7e66
|
Add PVC and update resource limits in k8s config (#8489)
|
2025-07-28 23:15:31 -07:00 |
|
Lifu Huang
|
fb16fbaf52
|
Fix incorrect KV cache allocation for MTP models. (#8482)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-07-28 22:54:50 -07:00 |
|
fzyzcjy
|
0ce84c822b
|
Support colocating requests (#7973)
|
2025-07-28 22:51:49 -07:00 |
|
fzyzcjy
|
59d0bf012f
|
Tiny add warnings for DeepEP when it is suboptimal (#8426)
|
2025-07-28 22:51:38 -07:00 |
|
fzyzcjy
|
7df2c0c2db
|
Reduce memory usage for fp4 moe (#8413)
|
2025-07-28 22:51:23 -07:00 |
|
Lianmin Zheng
|
69712e6f55
|
Rename the last step in pr-test.yml as pr-test-finish (#8486)
|
2025-07-28 19:06:13 -07:00 |
|
Lianmin Zheng
|
001bffca62
|
Update CODEOWNERS (#8485)
|
2025-07-28 17:57:23 -07:00 |
|
Keyang Ru
|
7c9697178e
|
[CI]Add genai-bench Performance Validation for PD Router (#8477)
Co-authored-by: key4ng <rukeyang@gamil.com>
|
2025-07-28 16:58:23 -07:00 |
|
Yineng Zhang
|
8240a6b013
|
chore: add glm 4.5 fp8 tp4 config (#8480)
|
2025-07-28 16:14:01 -07:00 |
|
Yineng Zhang
|
3a04aa4be7
|
chore: add glm4 fp8 tp8 config (#8478)
|
2025-07-28 16:08:53 -07:00 |
|
Lianmin Zheng
|
bd51694906
|
Update codeowner (#8476)
|
2025-07-28 16:03:49 -07:00 |
|
Stefan He
|
74e7e45710
|
Fix DEEPEP BF16 compatibility for Deepseek Style model like GLM 4.5 (#8469)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
|
2025-07-28 14:36:08 -07:00 |
|
Yineng Zhang
|
1466c1b896
|
feat: support glm4 tuning (#8473)
|
2025-07-28 14:32:58 -07:00 |
|
Cheng Wan
|
9c138a0445
|
[3/N] MoE Refactor: Simplify DeepEP Output (#8421)
|
2025-07-28 11:37:17 -07:00 |
|
Timofey
|
c8f549d96d
|
Fix parsing ChatCompletionMessage (#7273)
Co-authored-by: Timofey K <timosha1113@gmail.com>
|
2025-07-28 11:35:14 -07:00 |
|
Kaixi Hou
|
134fa43e19
|
[NVIDIA] Change to use num_local_experts (#8453)
|
2025-07-28 10:38:19 -07:00 |
|
Yineng Zhang
|
ccfe52a057
|
fix: update dep (#8467)
|
2025-07-28 10:19:33 -07:00 |
|
harrisonlimh
|
747dd45077
|
feat: throttle requests at scheduler based on --max_queued_requests (#7565)
|
2025-07-28 22:32:33 +08:00 |
|
Ke Bao
|
b582159246
|
Update PR template (#8465)
|
2025-07-28 22:12:36 +08:00 |
|
erictanjn
|
a9dd3ec3e9
|
fix:reorder topk experts to ensure shared expert replaces minimal score (#8125)
|
2025-07-28 20:36:46 +08:00 |
|
Yineng Zhang
|
45bc170b36
|
chore: bump v0.4.9.post5 (#8458)
|
2025-07-28 02:11:06 -07:00 |
|
Xiaoyu Zhang
|
2262369905
|
Revert "[kernel] opt moe align block kernel by block/warp scan algorithm" (#8457)
|
2025-07-28 01:35:43 -07:00 |
|
strgrb
|
fb4ce17de6
|
Fix per_token_group_quant_8bit when hidden_dim // group_size is not divided by 4. (#8449)
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
|
2025-07-28 01:32:46 -07:00 |
|
Minglei Zhu
|
25f73c6cf3
|
fix GLM4_MOE launch with compressed_tensor quant model (#8456)
|
2025-07-28 01:31:20 -07:00 |
|
Binyao Jiang
|
581e7dcb92
|
GLM-4.5 Model Support Follow-up (#8445)
|
2025-07-27 23:35:20 -07:00 |
|
Qiaolin Yu
|
484d0e021d
|
doc: add bench_one_batch_server in the benchmark doc (#8441)
|
2025-07-27 23:07:54 -07:00 |
|
kyleliang-nv
|
5922c0cbf6
|
Remove zstd compression for building Dockerfile.gb200 (#8442)
|
2025-07-27 22:58:53 -07:00 |
|
Yuxuan Zhang
|
6d6a8bc278
|
GLM-4.5 Model Support (#8224)
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-07-27 22:54:07 -07:00 |
|
Shangming Cai
|
2fd5c7049f
|
[PD] Fix abort_request for PD disaggregation (#8352)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
|
2025-07-27 21:48:27 -07:00 |
|
Stefan He
|
4ad9737045
|
chore: bump transformer to 4.54.0 (#8416)
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
|
2025-07-27 21:27:25 -07:00 |
|
Qiaolin Yu
|
2810338401
|
[feat] Support different attention backends for prefill and decode (#6338)
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-07-28 11:42:29 +08:00 |
|
Simo Lin
|
fe6a445d1e
|
[router] improve router logs and request id header (#8415)
|
2025-07-27 19:30:19 -07:00 |
|
Chang Su
|
dd487e5553
|
bugfix: Fix XGrammar backend to use model's EOS tokens for constrained generation (#8422)
|
2025-07-28 10:01:02 +08:00 |
|
kyleliang-nv
|
bb81daefb8
|
Fix docker buildx push error (#8425)
|
2025-07-27 17:59:38 -07:00 |
|
Chang Su
|
58dd95fbc8
|
Fix test_openai_server (#8419)
|
2025-07-27 13:36:01 -07:00 |
|
Chang Su
|
b47eda3316
|
bugfix: Fix multiple finish_reason chunks and tool_calls finish reason check (#8417)
|
2025-07-27 13:31:06 -07:00 |
|
Binyao Jiang
|
e983d66680
|
Fix: Improve test_openai_function_calling unit test and fix reasoning_parser.py think_start_token logic (#8316)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-07-27 13:12:59 -07:00 |
|
fzyzcjy
|
b58c3c285e
|
Support ue8m0 for triton quant kernel (#7603)
|
2025-07-27 13:04:35 -07:00 |
|
Lifu Huang
|
df90645525
|
Support overlapped lora updates (#8213)
|
2025-07-27 13:00:44 -07:00 |
|
kyleliang-nv
|
95217a9b4d
|
Change to use native arm runner (#8414)
|
2025-07-27 12:48:12 -07:00 |
|
Shangming Cai
|
22e00eeb4a
|
[Bugfix] Prevent PD server crash from invalid grammar (#8062)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
|
2025-07-28 00:17:51 +08:00 |
|
Yuan Luo
|
b3eac168e7
|
Support triton kernels v3.4.0 for fused_moe (#8258)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Cheng Wan <cwan@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-07-27 02:28:49 -07:00 |
|