Cheng Wan
|
3c2274fbee
|
Implement gather before attn (#6378)
|
2025-06-15 21:08:56 -07:00 |
|
Baizhou Zhang
|
d2679f5109
|
Fix ChunkCache object has no attribute 'disable' (#7217)
|
2025-06-15 20:55:15 -07:00 |
|
Byron Hsu
|
96be97bfff
|
Minor PD style fix (#7215)
|
2025-06-15 16:12:12 -07:00 |
|
Byron Hsu
|
88f9c347b2
|
[PD] use int32 for kv indices & get num_reserved_decode_tokens from server_args (#7214)
|
2025-06-15 11:51:03 -07:00 |
|
Lianmin Zheng
|
fff10809bf
|
Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210)
|
2025-06-15 02:48:00 -07:00 |
|
Lianmin Zheng
|
5f1ab32717
|
[EAGLE] Refactor code for page size > 1 & more simplifications (#7163)
|
2025-06-14 23:16:23 -07:00 |
|
Yineng Zhang
|
7df7c679b6
|
feat: use zstd for docker (#7205)
|
2025-06-14 23:13:29 -07:00 |
|
Lianmin Zheng
|
38af4f68a9
|
Fix grammar abort & Minor style fixes (#7204)
|
2025-06-14 22:49:41 -07:00 |
|
Lianmin Zheng
|
a6305c7d50
|
Lianmin/simplify memory pool (#7202)
|
2025-06-14 22:25:37 -07:00 |
|
Lianmin Zheng
|
a023856b12
|
Move host memory pools into a separate file (#7200)
|
2025-06-14 21:31:42 -07:00 |
|
Byron Hsu
|
db0cc57e75
|
[PD] Support decode retract and update decode.py (#7196)
|
2025-06-14 19:48:05 -07:00 |
|
fzyzcjy
|
349bb2c92a
|
Fix error when disabling new DeepGEMM (#7198)
|
2025-06-14 19:24:54 -07:00 |
|
fzyzcjy
|
0b8939bc2c
|
Fix NCCL 2.27.3 not in docker image (#7195)
|
2025-06-14 18:36:11 -07:00 |
|
JieXin Liang
|
ed89837cf4
|
chore: upgrade sgl-kernel v0.1.8.post2 (#7186)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-06-14 18:26:18 -07:00 |
|
JieXin Liang
|
55561e2553
|
[fix] fix determine_num_fused_shared_experts (#7180)
|
2025-06-14 17:41:22 -07:00 |
|
Yineng Zhang
|
4473320380
|
chore: bump v0.1.8.post2 (#7189)
|
2025-06-14 17:01:48 -07:00 |
|
Zhijian Liu
|
0bd67ba2bd
|
Fix a minor bug related to DeepGEMM upgrade (#7191)
|
2025-06-14 16:54:40 -07:00 |
|
Byron Hsu
|
7d316991b2
|
[PD] Update prefill.py (#7190)
|
2025-06-14 15:59:54 -07:00 |
|
JieXin Liang
|
ab1a4fa5cb
|
[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)
|
2025-06-14 12:45:41 -07:00 |
|
JieXin Liang
|
ed54bf9d19
|
[fix] fix dsv3 weight loader tqdm and simplify shared experts fusion (#7181)
|
2025-06-14 11:56:29 -07:00 |
|
fzyzcjy
|
b57d87c297
|
Fix shared experts fusion + weight requant (#7177)
|
2025-06-14 02:35:18 -07:00 |
|
Lifu Huang
|
98538822d5
|
Add Phi-4-mm to supported VLM supported model list. (#7178)
|
2025-06-13 23:17:40 -07:00 |
|
Lianmin Zheng
|
f47a1b1d0f
|
Increase timeout in test/srt/test_disaggregation.py (#7175)
|
2025-06-13 23:12:14 -07:00 |
|
fzyzcjy
|
93cec4335f
|
Support new DeepGEMM (#7172)
|
2025-06-13 23:00:17 -07:00 |
|
Lianmin Zheng
|
ba589b88fc
|
Improve test cases for eagle infer (#7173)
|
2025-06-13 22:25:13 -07:00 |
|
Jinn
|
50876abc47
|
Add test for refactored openai server (#7161)
|
2025-06-13 20:42:57 -07:00 |
|
fzyzcjy
|
b4c41f7276
|
Refactor DeepGEMM integration (#7150)
|
2025-06-13 20:41:03 -07:00 |
|
fzyzcjy
|
8b8f2e7463
|
Support new DeepGEMM input format in silu_and_mul_masked_post_quant_fwd (#7153)
|
2025-06-13 20:40:24 -07:00 |
|
Lianmin Zheng
|
0fc3d992bb
|
Split the eagle test into two files (#7170)
|
2025-06-13 20:14:26 -07:00 |
|
Lianmin Zheng
|
be2d985df8
|
Minor style change of triton backend (#7165)
|
2025-06-13 16:01:23 -07:00 |
|
fzyzcjy
|
5b1afa7814
|
Re-quantize DeepSeek model weights to support DeepGEMM new input format (#7156)
|
2025-06-13 15:57:45 -07:00 |
|
fzyzcjy
|
c49c1d9226
|
Remove 200us slow concat kernel (part 2: srt) (#7020)
|
2025-06-13 15:19:31 -07:00 |
|
fzyzcjy
|
0f1dfa1efe
|
Tiny add sanity checks for DeepGEMM inputs (#7157)
|
2025-06-13 14:36:27 -07:00 |
|
fzyzcjy
|
e3ec6bf4b6
|
Minor speed up block_quant_dequant (#6814)
|
2025-06-13 14:32:46 -07:00 |
|
fzyzcjy
|
b04df75acd
|
Fix DeepEP error in some environments (#7154)
|
2025-06-13 14:27:25 -07:00 |
|
fzyzcjy
|
bec3e48402
|
Support new DeepGEMM format in per token group quant (part 2: srt) (#7155)
|
2025-06-13 14:25:40 -07:00 |
|
Yineng Zhang
|
8ab7d93c2e
|
chore: bump v0.1.8.post1 (#7152)
|
2025-06-13 03:14:26 -07:00 |
|
fzyzcjy
|
5c66c4424f
|
Support new DeepGEMM format in per token group quant (#7146)
|
2025-06-13 02:00:22 -07:00 |
|
fzyzcjy
|
aa46ed34d2
|
Remove 200us slow concat kernel (part 1: kernel) (#7145)
|
2025-06-13 01:58:29 -07:00 |
|
pansicheng
|
2f4ec752bc
|
filter by num_hidden_layers (#7056)
|
2025-06-13 00:53:09 -07:00 |
|
fzyzcjy
|
da47621ccc
|
Minor speedup topk postprocessing (#7058)
|
2025-06-13 00:50:18 -07:00 |
|
Binyao Jiang
|
22a6b9fc05
|
Remove unnecessary metadata_expand.max_seq_len_k operations in fa3 to… (#7140)
|
2025-06-12 23:25:52 -07:00 |
|
fzyzcjy
|
b02df20a8d
|
Minor add utility to read expert distribution recorder output (#7134)
|
2025-06-12 16:50:05 -07:00 |
|
Povilas Kanapickas
|
bd7cfbd2f8
|
[Fix] Reduce busy polling when scheduler is idle (#6026)
|
2025-06-12 14:58:22 -07:00 |
|
sogalin
|
4b9971e401
|
Add gfx950 support for sgl-kernel. (#7092)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-06-12 11:07:48 -07:00 |
|
Lianmin Zheng
|
dcc79d325b
|
Update CODEOWNERS (#7126)
|
2025-06-12 02:12:49 -07:00 |
|
Yineng Zhang
|
7046e0fab7
|
feat: update blackwell setup (#7119)
|
2025-06-12 01:54:40 -07:00 |
|
Liangsheng Yin
|
930746d93c
|
Improve log status (#7115)
|
2025-06-12 14:38:24 +08:00 |
|
Yuan Luo
|
84727a5139
|
[sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-06-11 20:43:08 -07:00 |
|
Quanfeng Li
|
ef32677444
|
Fix positional argument (#7093)
|
2025-06-11 18:31:13 -07:00 |
|