Guanhua Wang
|
f7b2853ff8
|
[feat] support minimum token load balance in dp attention (#7379)
|
2025-08-03 00:46:47 -07:00 |
|
Zhiqiang Xie
|
b0add2da00
|
HiCache storage, style change and bug fix (#8719)
|
2025-08-03 15:05:04 +08:00 |
|
Wenxuan Tan
|
0305c5053f
|
Reduce memory accumulation in long-running server (#8306)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2025-08-03 15:03:16 +08:00 |
|
Lifu Huang
|
8675bdf246
|
Support limiting max loaded loras in CPU. (#8650)
|
2025-08-03 00:02:23 -07:00 |
|
Cheng Wan
|
a437aa9987
|
[hotfix] fix mixtral with tensor-level compressed-tensor quantization (#8721)
|
2025-08-02 22:59:25 -07:00 |
|
fzyzcjy
|
0e612dbf12
|
Tiny fix CI pytest error (#8524)
|
2025-08-02 22:48:42 -07:00 |
|
Liangsheng Yin
|
9f47d686e5
|
Fix fused MoE when routed_scaling_factor is None (#8709)
|
2025-08-03 12:42:01 +08:00 |
|
Qi Yuhang
|
d9def43dcd
|
[Perf]Use Cooperative Schedule for H100 & H200 & H800 in fp8_blockwise_scaled_grouped_mm (#8722)
|
2025-08-02 21:13:47 -07:00 |
|
DarkSharpness
|
e273aa6dcf
|
[Feature] Radix Tree in C++ (#7369)
|
2025-08-02 19:50:14 -07:00 |
|
Simo Lin
|
828a4fe944
|
[router] Implement HTTP Dependency Injection Pattern for Router System (#8714)
|
2025-08-02 19:16:47 -07:00 |
|
fzyzcjy
|
8ada1ab6c7
|
Fix triton moe error caused by TopK refactor (#8705)
|
2025-08-02 18:49:47 -07:00 |
|
Lianmin Zheng
|
e314b084c5
|
[FIX] Fix the nightly CI by disabling swa mem pool for gemma2 (#8693)
|
2025-08-02 18:43:14 -07:00 |
|
fzyzcjy
|
403566bcca
|
Remove assertions about per group quant fp8 (#8717)
|
2025-08-02 17:08:40 -07:00 |
|
Yineng Zhang
|
0a56b721d5
|
chore: bump sgl-kernel v0.2.9 (#8713)
|
2025-08-02 16:21:56 -07:00 |
|
Liangsheng Yin
|
603f5ce020
|
[Bug] fix green context's incompatibility with cuda < 12.4 (#8701)
|
2025-08-02 15:23:11 -07:00 |
|
Simo Lin
|
6d4fd8826e
|
[router] minor code clean up and and refactoring (#8711)
|
2025-08-02 13:46:31 -07:00 |
|
Liangsheng Yin
|
f9f0138f80
|
Revert "[1/2] sgl-kernel: Fuse routed scaling factor into select_experts" (#8706)
|
2025-08-02 20:14:30 +08:00 |
|
PGFLMG
|
ac6962ccd6
|
[Doc] Polish sgl-kernel readme for cu126 build error (#8704)
|
2025-08-02 17:03:07 +08:00 |
|
Stefan He
|
4ca43b061c
|
Add tensor.detach() back to update weight util (#8691)
|
2025-08-02 00:41:05 -07:00 |
|
Wenchen Lo
|
ea93079b30
|
model: adapt mllama4 to VisionAttention (#8512)
Co-authored-by: root <mickjagger19@icloud.com>
|
2025-08-02 00:39:40 -07:00 |
|
Yusong Gao
|
4bec99ecd0
|
Fix: resolve prefill of retracted request out-of-memory issue when ignore_eos is enabled (#7434)
|
2025-08-02 14:43:45 +08:00 |
|
Trevor Morris
|
89caf7a3c6
|
[bugfix] Apply routed scaling factor to cutlass_fused_experts_fp8 (#8688)
|
2025-08-01 19:00:24 -07:00 |
|
ishandhanani
|
b27b11919c
|
chore(gb200): update dockerfile to handle fp4 disaggregation (#8694)
|
2025-08-01 18:58:00 -07:00 |
|
Trevor Morris
|
f642524fd9
|
[1/2] sgl-kernel: Fuse routed scaling factor into select_experts (#8364)
|
2025-08-01 18:14:24 -07:00 |
|
Nicolas Castet
|
82e6c3a65a
|
Add support for NCCL symmetric memory for TP allreduces (#8238)
|
2025-08-01 23:30:55 +00:00 |
|
Baron Liu
|
b89d37cb11
|
[bugfix] Add 'disaggregation_mode' parameter to warmup function when compile deep_gemm manually (#8618)
|
2025-08-01 16:02:53 -07:00 |
|
Swipe4057
|
5deab1283a
|
upgrade xgrammar 0.1.22 (#8522)
|
2025-08-01 15:59:15 -07:00 |
|
hzh0425
|
d1c4d51c08
|
bugfix(hicache): Fix 'MooncakeStore' not defined error. (#8668)
|
2025-08-01 15:58:17 -07:00 |
|
YanbingJiang
|
1fe691a429
|
Fix FP8 block quantization when N or K is not multiples of 128 (#8648)
|
2025-08-01 15:57:19 -07:00 |
|
Ke Bao
|
e252192679
|
Fix deepgemm masked grouped gemm jit compile (#8679)
|
2025-08-01 15:37:59 -07:00 |
|
Lianmin Zheng
|
07e46ecaad
|
Update CODEOWNERS (#8686)
|
2025-08-01 15:09:44 -07:00 |
|
Simo Lin
|
ab9b893e61
|
[bug] limit bootstrap room to to [0, 2^63 - 1] (#8684)
|
2025-08-01 14:41:01 -07:00 |
|
Trevor Morris
|
6a7528e623
|
[bugfix] Fix page size for create_flashmla_kv_indices_triton() for cutlass mla (#8685)
|
2025-08-01 14:28:04 -07:00 |
|
Minglei Zhu
|
2ae95d17e8
|
Disable tp for shared experts under expert parallelism for GLM4.5 model (#8647) (#8647)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-08-01 12:02:35 -07:00 |
|
萝卜菜
|
2d401bd99d
|
[fix] fix pd disagg error of vlms (#8094)
|
2025-08-02 02:16:29 +08:00 |
|
Zac
|
b17c5b0118
|
fix arg typo for --disaggregation-transfer-backend (#8664)
|
2025-08-01 10:00:47 -07:00 |
|
Stefan He
|
db7343c992
|
fix per token cuda kernel hidden dim cannot divide by 16 (#8543)
|
2025-08-01 09:27:18 -07:00 |
|
Hongbo Xu
|
533cb5b274
|
[DOC]Update sgl-kernel README (#8665)
|
2025-08-01 22:59:27 +08:00 |
|
Peter Pan
|
6bdd27861b
|
[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013)
|
2025-08-01 22:01:24 +08:00 |
|
Lifu Huang
|
46e9d1c7c1
|
Increase tolerance to address CI failures (#8643)
|
2025-08-01 02:32:10 -07:00 |
|
Cheng Wan
|
6c88f6c8d9
|
[5/N] MoE Refactor: Update MoE parallelism arguments (#8658)
|
2025-08-01 01:20:03 -07:00 |
|
Binyao Jiang
|
c8d3a402c1
|
Bug: apply final_hidden_states*=self.routed_scaling_factor at MoE lay… (#8511)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-08-01 00:07:41 -07:00 |
|
Xinyuan Tong
|
7e831efee8
|
Fix chat template handling for OpenAI serving (#8635)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-31 21:49:45 -07:00 |
|
pansicheng
|
20b5563eda
|
Add hf3fs_utils.cpp to package-data (#8653)
|
2025-08-01 12:41:09 +08:00 |
|
Ke Bao
|
33f0de337d
|
chore: bump v0.4.10.post1 (#8652)
|
2025-08-01 12:07:30 +08:00 |
|
Baizhou Zhang
|
e7e5a3050a
|
Update batch size limitation of dsv3_router_gemm kernel to 16 (#8051)
|
2025-08-01 11:53:31 +08:00 |
|
Zhiqiang Xie
|
dd7ca00601
|
Interface change for kvcache io to support page first layout (#8318)
|
2025-08-01 11:37:49 +08:00 |
|
Zhiqiang Xie
|
9305ea6c2d
|
HiCache, fixing hash value indexing (#8636)
|
2025-08-01 11:29:51 +08:00 |
|
Kaixi Hou
|
aa4c66b564
|
[NVIDIA] Enable Flashinfer MoE blockscale fp8 backend for TP MoE (#8450)
Co-authored-by: kushanam <42385577+kushanam@users.noreply.github.com>
|
2025-07-31 19:56:34 -07:00 |
|
Simo Lin
|
39decec10b
|
[router] upgrade router version to 0.1.8 (#8645)
|
2025-07-31 19:00:23 -07:00 |
|