lambert0312
|
2e0f94ab79
|
[Fix] fix output_top_logprobs is not exist (#4597)
|
2025-03-27 21:45:57 -07:00 |
|
warjiang
|
18317ddc13
|
ci: add condition for daily docker build (#4487)
|
2025-03-27 21:44:37 -07:00 |
|
Vincent
|
e2e2ab70e0
|
IPv6 support (#3949)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-03-27 21:42:13 -07:00 |
|
fzyzcjy
|
0d3e3072ee
|
Fix CI of test_patch_torch (#4844)
|
2025-03-27 21:22:45 -07:00 |
|
fzyzcjy
|
62dd95870c
|
Remove retry in nightly tests (#4846)
|
2025-03-27 21:18:29 -07:00 |
|
Jiaqi
|
72031173e4
|
fix: fix typo of comments in w8a8_fp8.py (#4843)
|
2025-03-27 21:06:47 -07:00 |
|
Qiaolin Yu
|
9fdc6d6abc
|
Fix the lora adapter when lora path is none (#4799)
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
|
2025-03-27 21:03:08 -07:00 |
|
XinyuanTong
|
42a45df043
|
[Fix] self.worker assignment in TpModelWorker and refactor references (#4788)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-03-27 20:28:38 -07:00 |
|
Jon Durbin
|
04eb6062e4
|
Include context length in /v1/models response. (#4809)
|
2025-03-27 20:23:18 -07:00 |
|
Brayden Zhong
|
e84f4ba0ab
|
[Misc] Fix issues reported by torchfix (#4837)
|
2025-03-27 20:10:32 -07:00 |
|
Brayden Zhong
|
b149b39353
|
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
|
2025-03-27 19:45:02 -07:00 |
|
Yineng Zhang
|
31dfff7da7
|
use default for torch.ops (#4835)
|
2025-03-27 19:09:58 -07:00 |
|
Kebe
|
10a9ab7b07
|
Fix error due to CustomAllreduce setup failure (#4815)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-03-27 18:52:10 -07:00 |
|
Junrong Lin
|
bb0fd749a6
|
[Fix] Add compressed_tensors as deps (#4819)
|
2025-03-27 18:08:24 -07:00 |
|
tarinkk
|
7f19e083c1
|
Support (1 <= dp < tp) in the dp attention in DeepEP (#4770)
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
|
2025-03-27 17:09:35 -07:00 |
|
Daniel Holanda
|
98a2cfa9b2
|
Basic Cleanup (#4833)
|
2025-03-27 16:55:48 -07:00 |
|
Lianmin Zheng
|
2a882e8f3a
|
Fix the nightly eval by lowering the threshold of neuralmagic/gemma-2-2b-it-FP8 (#4830)
|
2025-03-27 16:09:49 -07:00 |
|
Ravi Theja
|
e6e4d02245
|
Update MMMU Benchmark instructions (#4694)
|
2025-03-27 14:44:16 -07:00 |
|
Juwan Yoo
|
188105a21b
|
deps: lazy import optional dependencies gguf and torchvision (#4826)
|
2025-03-27 14:35:36 -07:00 |
|
Ke Bao
|
b39532587b
|
Update doc for DeepSeek-V3-0324 (#4825)
|
2025-03-27 13:30:40 -07:00 |
|
Yineng Zhang
|
5fa3058f01
|
fix the release doc dependency issue (#4828)
|
2025-03-27 13:28:12 -07:00 |
|
Yineng Zhang
|
bbab97a6a8
|
add partial_json_parser and einops (#4827)
|
2025-03-27 13:24:54 -07:00 |
|
Juwan Yoo
|
0bc0bf5734
|
gemma3: impl get_attention_sliding_window_size for attn init (#4823)
|
2025-03-27 10:43:58 -07:00 |
|
Jiří Suchomel
|
f60f293195
|
[k8s] Clarified the usage of shared memory. (#4341)
|
2025-03-27 08:53:19 -07:00 |
|
AinL
|
17000d2b3a
|
Remove Unintended Capture Batch Sizes in AMD HIP Graph Runner (#4638)
|
2025-03-27 08:41:33 -07:00 |
|
strgrb
|
668ecc6c5b
|
Fix ut mla-test-1-gpu-amd (#4813)
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
|
2025-03-27 08:27:51 -07:00 |
|
strgrb
|
886fcbdd09
|
Use apply_rope_with_cos_sin_cache_inplace for DeepSeek (#4764)
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
|
2025-03-27 01:45:37 -07:00 |
|
Yineng Zhang
|
8bf6d7f406
|
support cmake for sgl-kernel (#4706)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
|
2025-03-27 01:42:28 -07:00 |
|
Stefan He
|
1b9175cb23
|
[FA3 Attn Backend] Remove Unnecessary Device Sync for FA3 (#4745)
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>
|
2025-03-27 00:45:11 -07:00 |
|
fzyzcjy
|
92bb49a7f9
|
Patch PyTorch's bug that cross-process tensor transfer will lead to wrong device (#4565)
|
2025-03-27 00:22:33 -07:00 |
|
Yineng Zhang
|
6f5cc5eb05
|
update xgrammar 0.1.17 (#4804)
|
2025-03-27 00:21:59 -07:00 |
|
Pan Lyu
|
c913ed4046
|
support clip embedding model (#4506)
|
2025-03-27 00:18:15 -07:00 |
|
Xihuai Wang
|
1afe3d0798
|
Align finish reason and stream mode in openai api (#4388)
|
2025-03-27 00:16:52 -07:00 |
|
Didier Durand
|
44f47d3ee1
|
Update supported_models.md: adding open-r1 Olympic Code 32B by HuggingFace (#4628)
|
2025-03-27 00:16:16 -07:00 |
|
laixin
|
ae25d36dc6
|
[3/3] fix dsv3 awq issue (#4719)
Co-authored-by: AniZpZ <aniz1905@gmail.com>
|
2025-03-26 23:13:43 -07:00 |
|
Yineng Zhang
|
1099f6c974
|
bump v0.4.4.post2 (#4669)
|
2025-03-26 19:58:00 -07:00 |
|
Xiaoyu Zhang
|
04e3ff6975
|
Support compressed tensors fp8w8a8 (#4743)
|
2025-03-26 13:21:25 -07:00 |
|
Yi Pan
|
45fdf1f7f3
|
Fix shared memory OOM on sm86 GPUs. (#4797)
|
2025-03-26 10:41:53 -07:00 |
|
Kebe
|
d89c0e4b7e
|
Use metadata to detect version of package (#4782)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-03-26 00:41:43 -07:00 |
|
fzyzcjy
|
fa3c9e0668
|
Fix popen_launch_server wait for 20 minutes when child process exits (#4777)
|
2025-03-26 00:32:19 -07:00 |
|
Cheng Wan
|
0d658ac3df
|
Support recording experts workload in QWen2-MoE (#4775)
|
2025-03-26 00:29:57 -07:00 |
|
Thysrael
|
ced35a0649
|
fix(typo): fix reply to replay in base_attn_backend.py (#4784)
|
2025-03-26 00:19:12 -07:00 |
|
fzyzcjy
|
26f07294f1
|
Warn users when release_memory_occupation is called without memory saver enabled (#4566)
|
2025-03-26 00:18:14 -07:00 |
|
Baizhou Zhang
|
34e07a65f1
|
[Fix] Fix unexpected idx bug of Phi-3-small (#4728)
|
2025-03-25 21:33:48 -07:00 |
|
fzyzcjy
|
15ddd84322
|
Add retry for flaky tests in CI (#4755)
|
2025-03-25 16:53:12 -07:00 |
|
fzyzcjy
|
52029bd1e3
|
Fix warmup error when dp=1 (#4753)
|
2025-03-25 02:01:21 -07:00 |
|
fzyzcjy
|
eb934bdf3b
|
Fix test_expert_distribution failure (#4752)
|
2025-03-25 01:17:03 -07:00 |
|
fzyzcjy
|
e45ae444db
|
Revert "Add DeepEP tests into CI (#4737)" (#4751)
|
2025-03-25 00:44:01 -07:00 |
|
DarkSharpness
|
ac3fae8445
|
[Feature] Support "strict" in function calling (#4310)
|
2025-03-24 22:15:25 -07:00 |
|
HandH1998
|
2d1b83e57a
|
add dsv3 int8 test (#4705)
|
2025-03-24 21:57:58 -07:00 |
|