Wenchen Lo
|
ea93079b30
|
model: adapt mllama4 to VisionAttention (#8512)
Co-authored-by: root <mickjagger19@icloud.com>
|
2025-08-02 00:39:40 -07:00 |
|
Yusong Gao
|
4bec99ecd0
|
Fix: resolve prefill of retracted request out-of-memory issue when ignore_eos is enabled (#7434)
|
2025-08-02 14:43:45 +08:00 |
|
Trevor Morris
|
89caf7a3c6
|
[bugfix] Apply routed scaling factor to cutlass_fused_experts_fp8 (#8688)
|
2025-08-01 19:00:24 -07:00 |
|
ishandhanani
|
b27b11919c
|
chore(gb200): update dockerfile to handle fp4 disaggregation (#8694)
|
2025-08-01 18:58:00 -07:00 |
|
Trevor Morris
|
f642524fd9
|
[1/2] sgl-kernel: Fuse routed scaling factor into select_experts (#8364)
|
2025-08-01 18:14:24 -07:00 |
|
Nicolas Castet
|
82e6c3a65a
|
Add support for NCCL symmetric memory for TP allreduces (#8238)
|
2025-08-01 23:30:55 +00:00 |
|
Baron Liu
|
b89d37cb11
|
[bugfix] Add 'disaggregation_mode' parameter to warmup function when compile deep_gemm manually (#8618)
|
2025-08-01 16:02:53 -07:00 |
|
Swipe4057
|
5deab1283a
|
upgrade xgrammar 0.1.22 (#8522)
|
2025-08-01 15:59:15 -07:00 |
|
hzh0425
|
d1c4d51c08
|
bugfix(hicache): Fix 'MooncakeStore' not defined error. (#8668)
|
2025-08-01 15:58:17 -07:00 |
|
YanbingJiang
|
1fe691a429
|
Fix FP8 block quantization when N or K is not multiples of 128 (#8648)
|
2025-08-01 15:57:19 -07:00 |
|
Ke Bao
|
e252192679
|
Fix deepgemm masked grouped gemm jit compile (#8679)
|
2025-08-01 15:37:59 -07:00 |
|
Lianmin Zheng
|
07e46ecaad
|
Update CODEOWNERS (#8686)
|
2025-08-01 15:09:44 -07:00 |
|
Simo Lin
|
ab9b893e61
|
[bug] limit bootstrap room to to [0, 2^63 - 1] (#8684)
|
2025-08-01 14:41:01 -07:00 |
|
Trevor Morris
|
6a7528e623
|
[bugfix] Fix page size for create_flashmla_kv_indices_triton() for cutlass mla (#8685)
|
2025-08-01 14:28:04 -07:00 |
|
Minglei Zhu
|
2ae95d17e8
|
Disable tp for shared experts under expert parallelism for GLM4.5 model (#8647) (#8647)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-08-01 12:02:35 -07:00 |
|
萝卜菜
|
2d401bd99d
|
[fix] fix pd disagg error of vlms (#8094)
|
2025-08-02 02:16:29 +08:00 |
|
Zac
|
b17c5b0118
|
fix arg typo for --disaggregation-transfer-backend (#8664)
|
2025-08-01 10:00:47 -07:00 |
|
Stefan He
|
db7343c992
|
fix per token cuda kernel hidden dim cannot divide by 16 (#8543)
|
2025-08-01 09:27:18 -07:00 |
|
Hongbo Xu
|
533cb5b274
|
[DOC]Update sgl-kernel README (#8665)
|
2025-08-01 22:59:27 +08:00 |
|
Peter Pan
|
6bdd27861b
|
[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013)
|
2025-08-01 22:01:24 +08:00 |
|
Lifu Huang
|
46e9d1c7c1
|
Increase tolerance to address CI failures (#8643)
|
2025-08-01 02:32:10 -07:00 |
|
Cheng Wan
|
6c88f6c8d9
|
[5/N] MoE Refactor: Update MoE parallelism arguments (#8658)
|
2025-08-01 01:20:03 -07:00 |
|
Binyao Jiang
|
c8d3a402c1
|
Bug: apply final_hidden_states*=self.routed_scaling_factor at MoE lay… (#8511)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-08-01 00:07:41 -07:00 |
|
Xinyuan Tong
|
7e831efee8
|
Fix chat template handling for OpenAI serving (#8635)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-31 21:49:45 -07:00 |
|
pansicheng
|
20b5563eda
|
Add hf3fs_utils.cpp to package-data (#8653)
|
2025-08-01 12:41:09 +08:00 |
|
Ke Bao
|
33f0de337d
|
chore: bump v0.4.10.post1 (#8652)
|
2025-08-01 12:07:30 +08:00 |
|
Baizhou Zhang
|
e7e5a3050a
|
Update batch size limitation of dsv3_router_gemm kernel to 16 (#8051)
|
2025-08-01 11:53:31 +08:00 |
|
Zhiqiang Xie
|
dd7ca00601
|
Interface change for kvcache io to support page first layout (#8318)
|
2025-08-01 11:37:49 +08:00 |
|
Zhiqiang Xie
|
9305ea6c2d
|
HiCache, fixing hash value indexing (#8636)
|
2025-08-01 11:29:51 +08:00 |
|
Kaixi Hou
|
aa4c66b564
|
[NVIDIA] Enable Flashinfer MoE blockscale fp8 backend for TP MoE (#8450)
Co-authored-by: kushanam <42385577+kushanam@users.noreply.github.com>
|
2025-07-31 19:56:34 -07:00 |
|
Simo Lin
|
39decec10b
|
[router] upgrade router version to 0.1.8 (#8645)
|
2025-07-31 19:00:23 -07:00 |
|
Simo Lin
|
f6f46f4629
|
[router] add basic usage doc (#8640)
|
2025-07-31 18:11:48 -07:00 |
|
Simo Lin
|
2886e23dbd
|
[bugfix] fix router python parser for pd urls (#8644)
|
2025-07-31 18:09:31 -07:00 |
|
Even Zhou
|
99795d61e6
|
[Bugfix] fix w8a8_int8 load issue (#8308)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-07-31 17:30:16 -07:00 |
|
li chaoran
|
fe5086fd8b
|
chore: speedup NPU CI by cache (#8270)
Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-07-31 17:29:50 -07:00 |
|
yrk111222
|
04913430c6
|
Feature/modelscope model download (#8083)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-07-31 17:29:31 -07:00 |
|
Yineng Zhang
|
0ad098b494
|
Revert "Fix nan value generated after custom all reduce (#8532)" (#8642)
|
2025-07-31 17:26:49 -07:00 |
|
kk
|
4a6e7a66a0
|
Fix nan value generated after custom all reduce (#8532)
|
2025-07-31 16:15:43 -07:00 |
|
Faraz
|
4b04998d38
|
TRTLLM Gen MLA Decode Kernel Integration (same as #7938) (#8632)
Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>
|
2025-07-31 16:03:40 -07:00 |
|
pansicheng
|
3dde86194a
|
Conditionally import HiCacheHF3FS (#8598)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 14:59:29 -07:00 |
|
Trevor Morris
|
b7170cc820
|
[bugfix] Fix flashinfer cutlass EP moe after MoE refactor (#8630)
|
2025-07-31 13:57:08 -07:00 |
|
Simo Lin
|
5c14515fec
|
[bug] remove pdlb from minilb since its no longer available (#8634)
|
2025-07-31 13:54:02 -07:00 |
|
Vishwanath Venkatesan
|
2cd2e27f80
|
SGLang HiCache NIXL Connector (#8488)
Signed-off-by: Vishwanath Venkatesan <vvenkatesan@nvidia.com>
Co-authored-by: Moein Khazraee <moein@nvidia.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 13:09:42 -07:00 |
|
Chang Su
|
743638bc03
|
misc: Remove debug print to logger.info (#8633)
|
2025-07-31 12:56:52 -07:00 |
|
Michael Yao
|
061c8959ff
|
Fix typos in py_test/test_launch_server.py (#6227)
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
|
2025-07-31 12:48:47 -07:00 |
|
Brayden Zhong
|
4acf690206
|
[Optimization][Perf] Disable the GC during CUDA graph capture to speed up by up to 3x (#8577)
|
2025-07-31 11:31:21 -07:00 |
|
Simo Lin
|
aee0ef52f5
|
[router] update router pypi version (#8628)
|
2025-07-31 11:24:12 -07:00 |
|
Simo Lin
|
ae807774f5
|
[ci] fix genai-bench execution cmd (#8629)
|
2025-07-31 10:40:54 -07:00 |
|
Ke Bao
|
8fbcfd0723
|
Update step3v default config (#8626)
|
2025-08-01 00:49:26 +08:00 |
|
Ke Bao
|
3c307dc057
|
Fix hf3fs_fuse import error (#8623)
|
2025-07-31 22:42:31 +08:00 |
|