James Liu
|
9e0186f352
|
[Feature] Support EAGLE 3 (#4247)
|
2025-03-18 07:35:23 -07:00 |
|
Wei Wu
|
8baf9a0c18
|
[Fix] Type annotation correction for UpdateWeightsFromTensorReqInput (#4532)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-03-18 00:52:47 -07:00 |
|
Yineng Zhang
|
c787298547
|
use sgl custom all reduce (#4441)
|
2025-03-18 00:46:41 -07:00 |
|
Ke Bao
|
45212ce18b
|
Add deepseek v2 torch compile pr test (#4538)
|
2025-03-18 00:29:24 -07:00 |
|
Yineng Zhang
|
c16b33ccac
|
cleanup deps 3/n (#4541)
|
2025-03-18 00:11:36 -07:00 |
|
Albert
|
2d0045125f
|
Fix the incorrect args in benchmark_and_profiling.md (#4542)
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
|
2025-03-18 00:07:06 -07:00 |
|
Xiaoyu Zhang
|
804d250a0d
|
remove useless backend forward in rotary_embedding (#4500)
|
2025-03-17 23:54:00 -07:00 |
|
Xiaoyu Zhang
|
dd865befde
|
[Hotfix] solve fp8 w8a8 ci test fail (#4531)
|
2025-03-17 23:17:04 -07:00 |
|
Mick
|
d373a48c98
|
fix: second_per_grid_ts should be used to get mrope position (#3682)
|
2025-03-17 18:12:38 -07:00 |
|
Mick
|
98be3bd306
|
refactor: rewrite bench-mmmu-sglang (#4458)
|
2025-03-17 18:11:47 -07:00 |
|
Zhiqiang Xie
|
a98290aea3
|
Unit test for Hierarchical Caching (#4486)
|
2025-03-17 17:45:00 -07:00 |
|
Xiaoyu Zhang
|
9b81f9bd34
|
sglang quant module remove vllm dependency (#4507)
|
2025-03-17 15:51:59 -07:00 |
|
Yineng Zhang
|
f81a27f65e
|
upgrade sgl-kernel 0.0.5.post3 (#4522)
|
2025-03-17 14:49:56 -07:00 |
|
Yineng Zhang
|
988ab646ec
|
bump v0.0.5.post3 (#4520)
|
2025-03-17 13:05:59 -07:00 |
|
Ke Bao
|
3ded4b215d
|
Revert "feat: update grouped_topk to support softmax and sigmoid" (#4505)
|
2025-03-17 11:30:26 -07:00 |
|
Yinghai Lu
|
f4d7ab7a63
|
[sgl-router] improvement to avoid hang (#4482)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2025-03-17 10:37:50 -07:00 |
|
Lianmin Zheng
|
c38ca4fc8e
|
Update readme (#4517)
|
2025-03-17 08:22:42 -07:00 |
|
Lianmin Zheng
|
82dec1f70b
|
Remove redundant type conversion (#4513)
|
2025-03-17 05:57:35 -07:00 |
|
yiakwy-xpu-ml-framework-team
|
5f9b2c62ff
|
[ROCm] fix dtype (#4510)
|
2025-03-17 05:20:50 -07:00 |
|
Lianmin Zheng
|
5493c3343e
|
Fix data parallel + tensor parallel (#4499)
|
2025-03-17 05:13:16 -07:00 |
|
HandH1998
|
f2ab37e500
|
[Doc] add doc for quantization w8a8_fp8 or w8a8_int8 (#4495)
|
2025-03-17 02:25:00 -07:00 |
|
Wei Wu
|
91ba98fe50
|
[Fix] Resolve GPU Memory Leak in update_weights_from_tensor (#4446)
|
2025-03-17 08:54:30 +00:00 |
|
Yinghai Lu
|
c614dbdf95
|
Nicer standalone engine inferface (#4480)
|
2025-03-17 01:42:04 -07:00 |
|
Xihuai Wang
|
927ca935a7
|
Constraint Decoding: Tool call with text (#4067)
|
2025-03-17 01:06:46 -07:00 |
|
Stefan He
|
ef3c2dd08e
|
Support Online Quantization for W8A8 (#4485)
|
2025-03-17 00:28:56 -07:00 |
|
Wenbo Yang
|
75b656488a
|
Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418)
|
2025-03-17 00:03:43 -07:00 |
|
Mick
|
0f52fb55ec
|
config: Update fused moe config (#4493)
|
2025-03-16 23:51:58 -07:00 |
|
萝卜菜
|
d6d21640d3
|
[Feature] Support Deepseek-VL2 (#2798)
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
|
2025-03-16 23:07:59 -07:00 |
|
JieXin Liang
|
0212d2e288
|
[Fix] use torch.inference_mode() instead of torch.no_grad() (#4372)
|
2025-03-16 22:54:16 -07:00 |
|
Byron Hsu
|
8cc300f536
|
Fix router test (#4483)
|
2025-03-16 22:49:47 -07:00 |
|
mlmz
|
452db50808
|
Constraint Decoding: Set xgrammar as the default grammar backend (#4386)
|
2025-03-16 18:53:43 -07:00 |
|
Rin Intachuen
|
d1112d8548
|
Add endpoint for file support, purely to speed up processing of input_embeds. (#2797)
|
2025-03-16 18:30:37 -07:00 |
|
woodx
|
48efec7b05
|
Feature: support code completion (#3612)
|
2025-03-16 18:26:19 -07:00 |
|
yiakwy-xpu-ml-framework-team
|
9b8333d992
|
[ROCm] enable moe topk softmax in amd (#4448)
|
2025-03-16 18:16:55 -07:00 |
|
Zhiqiang Xie
|
f5bbf6037d
|
Fix: Complete int32 to int64 conversion (#4465)
|
2025-03-16 18:14:27 -07:00 |
|
huiwq1990
|
5cbd709ea1
|
Fix: modelscope env comment (#4474)
Signed-off-by: huiwq1990 <huiwq1990@163.com>
|
2025-03-16 18:11:33 -07:00 |
|
Yinghai Lu
|
2e4a1e2d05
|
Initialize image processor for skip-tokenizer-init codepath (#4479)
Co-authored-by: Alex Kirillov <alex@iterationlab.org>
|
2025-03-16 18:10:09 -07:00 |
|
Mick
|
9d02bb3e2a
|
Urgent model support: support gemma-3-it (#4424)
|
2025-03-16 17:37:32 -07:00 |
|
ZelinTan
|
402db5c58c
|
Benchmark: Statistical Analysis of the Output Stability of the Deepseek Model (#4202)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2025-03-16 17:32:57 -07:00 |
|
Lianmin Zheng
|
754a0e8278
|
Update CODEOWNERS (#4484)
|
2025-03-16 17:10:15 -07:00 |
|
Yinghai Lu
|
799fb5f455
|
400 on empty input_ids (#4481)
|
2025-03-16 14:01:23 -07:00 |
|
Yi Zhang
|
25e1816eff
|
fix custom allreduce performance/accuracy problem (#4477)
|
2025-03-16 12:16:30 -07:00 |
|
lukec
|
a53fe428f9
|
Support FlashMLA backend (#4472)
Co-authored-by: yinfan98 <1106310035@qq.com>
|
2025-03-16 09:07:06 -07:00 |
|
Ying Sheng
|
1b859295f4
|
[Eagle] Remove the greedy branch and some redundant code (#4363)
Co-authored-by: Sehoon Kim <sehoon@x.ai>
|
2025-03-16 02:48:55 -07:00 |
|
Yineng Zhang
|
9971dc2283
|
Revert "feat: Add FlashMLA submodule (#4449)" (#4470)
|
2025-03-16 01:30:05 -07:00 |
|
Lianmin Zheng
|
3db35c1af4
|
Release sgl-kernel v0.0.5.post2 (#4469)
|
2025-03-16 01:01:53 -07:00 |
|
Ying Sheng
|
52a34d7448
|
Add greedy verification kernel (#4383)
|
2025-03-16 00:58:26 -07:00 |
|
Lianmin Zheng
|
06d12b39d3
|
Remove filter for pr-tests (#4468)
|
2025-03-16 00:57:26 -07:00 |
|
Lianmin Zheng
|
c30976fb41
|
Fix finish step for pr tests and notebook tests (#4467)
|
2025-03-16 00:52:06 -07:00 |
|
JieXin Liang
|
1a3fa75f2f
|
[Fix] use torch.cat instead of torch.concat to prevent entering the Autograd backends. (#4466)
|
2025-03-16 00:02:47 -07:00 |
|