yinfan98
|
37c66ec856
|
[feat] add fa3 in sgl-kernel (#4902)
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
|
2025-03-30 12:57:10 -07:00 |
|
Lianmin Zheng
|
9adf178cc2
|
Fix 2-gpu CI test and suppress some warnings (#4930)
|
2025-03-30 12:51:44 -07:00 |
|
Lianmin Zheng
|
f842853a40
|
Fix the timeout for unit-test-2-gpu in pr-test.yml (#4927)
|
2025-03-30 12:15:40 -07:00 |
|
Yineng Zhang
|
195a09f57c
|
fix bmm fp8 (#4926)
|
2025-03-30 12:15:20 -07:00 |
|
Adarsh Shirawalmath
|
9fccda3111
|
[Feature] use pytest for sgl-kernel (#4896)
|
2025-03-30 10:36:52 -07:00 |
|
Lianmin Zheng
|
4ede6770cd
|
Fix retract for page size > 1 (#4914)
|
2025-03-30 02:57:15 -07:00 |
|
Lianmin Zheng
|
b26bc86b36
|
Support page size > 1 + eagle (#4908)
|
2025-03-30 00:46:23 -07:00 |
|
Yi Zhang
|
5ec5eaf760
|
fix allreduce test (#4909)
|
2025-03-29 23:16:53 -07:00 |
|
yinfan98
|
0d7fe866f9
|
[Misc] Clean m.def and add Development Tips (#4890)
|
2025-03-29 23:06:18 -07:00 |
|
Yineng Zhang
|
54b9a2de0a
|
remove setup for sgl-kernel (#4899)
|
2025-03-29 12:47:38 -07:00 |
|
yinfan98
|
8e7b31546c
|
quick fix: add default for new kernel (#4898)
|
2025-03-29 12:31:59 -07:00 |
|
Qingquan Song
|
45dcfc2e76
|
Add deepseek style fused moe group gate selection kernel (#4530)
|
2025-03-29 11:51:45 -07:00 |
|
yinfan98
|
ddf8981d91
|
Delete test_deep_gemm.py (#4891)
|
2025-03-29 10:46:11 -07:00 |
|
Yineng Zhang
|
400ad66019
|
Update CODEOWNERS (#4889)
|
2025-03-29 09:56:51 -07:00 |
|
yinfan98
|
05625b9792
|
[Docs] Update DeepGEMM at README.md (#4886)
|
2025-03-29 09:53:39 -07:00 |
|
fzyzcjy
|
736502d4fd
|
Tiny fix doc error (#4795)
|
2025-03-29 08:22:17 -07:00 |
|
fzyzcjy
|
8690c40bb0
|
Improve stack trace of retry errors (#4845)
|
2025-03-29 08:21:31 -07:00 |
|
fzyzcjy
|
b1cfb4e972
|
Fix BadRequestError wrong arguments and remove openai dependency (#4882)
|
2025-03-29 08:16:21 -07:00 |
|
Yineng Zhang
|
19e96e5923
|
bump v0.4.4.post3 (#4878)
|
2025-03-28 23:21:24 -07:00 |
|
Ke Bao
|
aa08aeacf4
|
update torch compile doc (#4874)
|
2025-03-28 19:49:30 -07:00 |
|
Yineng Zhang
|
d8a136a113
|
upgrade sgl-kernel 0.0.5.post4 (#4873)
|
2025-03-28 19:48:56 -07:00 |
|
Baizhou Zhang
|
20c90be23d
|
[Feature] Support FA3 backend for MLA (#4831)
|
2025-03-28 18:30:14 -07:00 |
|
Yineng Zhang
|
ec3ee0289d
|
fix sgl-kernel cu118 build (#4872)
|
2025-03-28 17:23:51 -07:00 |
|
Yineng Zhang
|
92941ce7b5
|
bump sgl-kernel 0.0.5.post4 (#4768)
|
2025-03-28 14:40:53 -07:00 |
|
Yineng Zhang
|
2bb0e7cf43
|
fix sampling issue (#4871)
|
2025-03-28 14:07:21 -07:00 |
|
Yineng Zhang
|
72549263c6
|
update sgl-kernel test ci (#4866)
|
2025-03-28 11:42:41 -07:00 |
|
Qingquan Song
|
044c315970
|
Make torch compile configurable for biased_grouped_topk (#4749)
|
2025-03-28 10:57:52 -07:00 |
|
yinfan98
|
4db29e82ec
|
[Feat] support deepgemm for cmake (#4864)
|
2025-03-28 10:51:44 -07:00 |
|
Fr4nk1in
|
c483377ed7
|
Fix wrong variable name when stopping memory profile (#4772)
|
2025-03-28 10:35:02 -07:00 |
|
Lianmin Zheng
|
74e0ac1dbd
|
Clean up import vllm in quantization/__init__.py (#4834)
|
2025-03-28 10:34:10 -07:00 |
|
chaobo jia
|
ef9a378a20
|
[Feature] add multi-rank support for Lora (#4492)
Co-authored-by: rudy152 <czh1137892874@gmail.com>
|
2025-03-28 09:38:44 -07:00 |
|
Yineng Zhang
|
6dea5c96bf
|
Revert "get the python version from env (#4729)" (#4863)
|
2025-03-28 08:07:48 -07:00 |
|
Qingquan Song
|
6ffb6bd47a
|
Fix fa3 cuda graph page_size > 1 precision and page_size=1 speed (#4855)
|
2025-03-28 01:35:59 -07:00 |
|
Lianmin Zheng
|
47e6628aae
|
Fix CI tests (#4853)
|
2025-03-28 00:28:35 -07:00 |
|
Juwan Yoo
|
7907f9eb20
|
test: reduce mem_fraction_static for gemma3 vision test (#4840)
|
2025-03-27 23:20:10 -07:00 |
|
fzyzcjy
|
8c04f0f2e1
|
Support with_stack and record_shapes in profiler (#4740)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-03-27 23:01:42 -07:00 |
|
fzyzcjy
|
265e756494
|
Super tiny remove unused code (#4750)
|
2025-03-27 22:32:14 -07:00 |
|
fzyzcjy
|
d3f71f5e19
|
Fix torch.cuda.MemPool() internal assertion failure (#4687)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-03-27 22:29:36 -07:00 |
|
DavidChan
|
5eae67cb1f
|
get the python version from env (#4729)
|
2025-03-27 22:26:42 -07:00 |
|
vikram singh shekhawat
|
6dbf99982f
|
Fix missing arguments in SchedulePolicy and RadixCache initialization in tests. (#4712)
|
2025-03-27 22:23:51 -07:00 |
|
Kebe
|
e0166f8ab4
|
Remove empty tool function name (#4704)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-03-27 22:23:30 -07:00 |
|
fzyzcjy
|
53a2c3b466
|
Support controlling nsys start and end range programmatically (#4688)
|
2025-03-27 22:21:13 -07:00 |
|
BroadbentJim
|
550586ef42
|
fix: Inappropriate lack of Optional type on OpenAI ChatCompletionRequest (#4681)
|
2025-03-27 22:19:05 -07:00 |
|
fzyzcjy
|
cf29fe9e78
|
Fix Engine error when enabling DP attention (#4648)
|
2025-03-27 22:17:30 -07:00 |
|
Stefan He
|
26c0f13126
|
Support Page Size > 1 for FA3 (#4832)
Co-authored-by: Qingquan Song <ustcsqq@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-03-27 22:07:14 -07:00 |
|
rongfu.leng
|
f9970bd1af
|
fix: when use SGLANG_PORT this env,port is str (#4528)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
|
2025-03-27 21:46:06 -07:00 |
|
lambert0312
|
2e0f94ab79
|
[Fix] fix output_top_logprobs is not exist (#4597)
|
2025-03-27 21:45:57 -07:00 |
|
warjiang
|
18317ddc13
|
ci: add condition for daily docker build (#4487)
|
2025-03-27 21:44:37 -07:00 |
|
Vincent
|
e2e2ab70e0
|
IPv6 support (#3949)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-03-27 21:42:13 -07:00 |
|
fzyzcjy
|
0d3e3072ee
|
Fix CI of test_patch_torch (#4844)
|
2025-03-27 21:22:45 -07:00 |
|