Baizhou Zhang
|
d2679f5109
|
Fix ChunkCache object has no attribute 'disable' (#7217)
|
2025-06-15 20:55:15 -07:00 |
|
Byron Hsu
|
96be97bfff
|
Minor PD style fix (#7215)
|
2025-06-15 16:12:12 -07:00 |
|
Byron Hsu
|
88f9c347b2
|
[PD] use int32 for kv indices & get num_reserved_decode_tokens from server_args (#7214)
|
2025-06-15 11:51:03 -07:00 |
|
Lianmin Zheng
|
fff10809bf
|
Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210)
|
2025-06-15 02:48:00 -07:00 |
|
Lianmin Zheng
|
5f1ab32717
|
[EAGLE] Refactor code for page size > 1 & more simplifications (#7163)
|
2025-06-14 23:16:23 -07:00 |
|
Lianmin Zheng
|
38af4f68a9
|
Fix grammar abort & Minor style fixes (#7204)
|
2025-06-14 22:49:41 -07:00 |
|
Lianmin Zheng
|
a6305c7d50
|
Lianmin/simplify memory pool (#7202)
|
2025-06-14 22:25:37 -07:00 |
|
Lianmin Zheng
|
a023856b12
|
Move host memory pools into a separate file (#7200)
|
2025-06-14 21:31:42 -07:00 |
|
Byron Hsu
|
db0cc57e75
|
[PD] Support decode retract and update decode.py (#7196)
|
2025-06-14 19:48:05 -07:00 |
|
fzyzcjy
|
349bb2c92a
|
Fix error when disabling new DeepGEMM (#7198)
|
2025-06-14 19:24:54 -07:00 |
|
JieXin Liang
|
ed89837cf4
|
chore: upgrade sgl-kernel v0.1.8.post2 (#7186)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-06-14 18:26:18 -07:00 |
|
JieXin Liang
|
55561e2553
|
[fix] fix determine_num_fused_shared_experts (#7180)
|
2025-06-14 17:41:22 -07:00 |
|
Zhijian Liu
|
0bd67ba2bd
|
Fix a minor bug related to DeepGEMM upgrade (#7191)
|
2025-06-14 16:54:40 -07:00 |
|
Byron Hsu
|
7d316991b2
|
[PD] Update prefill.py (#7190)
|
2025-06-14 15:59:54 -07:00 |
|
JieXin Liang
|
ab1a4fa5cb
|
[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)
|
2025-06-14 12:45:41 -07:00 |
|
JieXin Liang
|
ed54bf9d19
|
[fix] fix dsv3 weight loader tqdm and simplify shared experts fusion (#7181)
|
2025-06-14 11:56:29 -07:00 |
|
fzyzcjy
|
b57d87c297
|
Fix shared experts fusion + weight requant (#7177)
|
2025-06-14 02:35:18 -07:00 |
|
Lianmin Zheng
|
f47a1b1d0f
|
Increase timeout in test/srt/test_disaggregation.py (#7175)
|
2025-06-13 23:12:14 -07:00 |
|
fzyzcjy
|
93cec4335f
|
Support new DeepGEMM (#7172)
|
2025-06-13 23:00:17 -07:00 |
|
fzyzcjy
|
b4c41f7276
|
Refactor DeepGEMM integration (#7150)
|
2025-06-13 20:41:03 -07:00 |
|
fzyzcjy
|
8b8f2e7463
|
Support new DeepGEMM input format in silu_and_mul_masked_post_quant_fwd (#7153)
|
2025-06-13 20:40:24 -07:00 |
|
Lianmin Zheng
|
be2d985df8
|
Minor style change of triton backend (#7165)
|
2025-06-13 16:01:23 -07:00 |
|
fzyzcjy
|
5b1afa7814
|
Re-quantize DeepSeek model weights to support DeepGEMM new input format (#7156)
|
2025-06-13 15:57:45 -07:00 |
|
fzyzcjy
|
c49c1d9226
|
Remove 200us slow concat kernel (part 2: srt) (#7020)
|
2025-06-13 15:19:31 -07:00 |
|
fzyzcjy
|
0f1dfa1efe
|
Tiny add sanity checks for DeepGEMM inputs (#7157)
|
2025-06-13 14:36:27 -07:00 |
|
fzyzcjy
|
e3ec6bf4b6
|
Minor speed up block_quant_dequant (#6814)
|
2025-06-13 14:32:46 -07:00 |
|
fzyzcjy
|
b04df75acd
|
Fix DeepEP error in some environments (#7154)
|
2025-06-13 14:27:25 -07:00 |
|
fzyzcjy
|
bec3e48402
|
Support new DeepGEMM format in per token group quant (part 2: srt) (#7155)
|
2025-06-13 14:25:40 -07:00 |
|
pansicheng
|
2f4ec752bc
|
filter by num_hidden_layers (#7056)
|
2025-06-13 00:53:09 -07:00 |
|
fzyzcjy
|
da47621ccc
|
Minor speedup topk postprocessing (#7058)
|
2025-06-13 00:50:18 -07:00 |
|
Binyao Jiang
|
22a6b9fc05
|
Remove unnecessary metadata_expand.max_seq_len_k operations in fa3 to… (#7140)
|
2025-06-12 23:25:52 -07:00 |
|
fzyzcjy
|
b02df20a8d
|
Minor add utility to read expert distribution recorder output (#7134)
|
2025-06-12 16:50:05 -07:00 |
|
Povilas Kanapickas
|
bd7cfbd2f8
|
[Fix] Reduce busy polling when scheduler is idle (#6026)
|
2025-06-12 14:58:22 -07:00 |
|
Liangsheng Yin
|
930746d93c
|
Improve log status (#7115)
|
2025-06-12 14:38:24 +08:00 |
|
Quanfeng Li
|
ef32677444
|
Fix positional argument (#7093)
|
2025-06-11 18:31:13 -07:00 |
|
Lifu Huang
|
021f76e4f4
|
[Perf] Refactor LoRAManager to eliminate stream syncs and redundant computations (#6994)
|
2025-06-11 16:18:57 -07:00 |
|
Faradawn Yang
|
777688b892
|
[feat]: Emit fixed-size KV blocks events (#6824)
|
2025-06-11 13:07:58 -07:00 |
|
Neo
|
0ca594eda9
|
[FIX]remove redundant code in logits_processor.py (#7079)
|
2025-06-11 11:49:30 -07:00 |
|
Zijian
|
31d6dee5c4
|
Support VILA models (#6106)
|
2025-06-11 11:47:25 -07:00 |
|
sogalin
|
02543b545c
|
Fix misusing the "_is_cuda". (#7091)
|
2025-06-11 11:21:31 -07:00 |
|
Baizhou Zhang
|
25a6a9aa22
|
Fix circular import in test_prefix_chunk_info.py (#7097)
|
2025-06-11 10:57:45 -07:00 |
|
Mick
|
83d87685c5
|
vlm: adapt internvl to VisionAttention (#6870)
|
2025-06-11 01:16:04 -07:00 |
|
Baizhou Zhang
|
2a5f0100e0
|
Fix GGuf and add back test_gguf.py (#7067)
|
2025-06-10 21:07:20 -07:00 |
|
Lianmin Zheng
|
dbdf76ca98
|
Clean up docs for server args and sampling parameters (generated by grok) (#7076)
|
2025-06-10 19:55:42 -07:00 |
|
Lianmin Zheng
|
6b12d6a8d5
|
Simplify the heuristics for setting --mem-fraction-static (#7054)
|
2025-06-10 19:01:39 -07:00 |
|
Yudi Xue
|
14c18d25df
|
Frontend language separate reasoning support (#6031)
|
2025-06-10 17:11:29 -07:00 |
|
Brayden Zhong
|
ca9291181d
|
[Feature] Add Logit Bias (#6579)
Co-authored-by: Cinjon Resnick <cinjon.resnick@gmail.com>
|
2025-06-10 15:39:25 -07:00 |
|
kyle-pena-kuzco
|
b56de8f943
|
Open AI API hidden states (#6716)
|
2025-06-10 14:37:29 -07:00 |
|
Xu Wenqing
|
a0e4d4eb53
|
Fix missing tool call id if tool call index >0 in streaming tool call output. (#7049)
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
|
2025-06-10 12:56:43 -07:00 |
|
kk
|
8ea7df6114
|
[WA] fix output data is nan in CI test "test_moe_eval_accuracy_large.py" (#7021)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2025-06-10 16:08:10 +00:00 |
|