Commit Graph

19 Commits

Author SHA1 Message Date
fromck
74d4f804e8 add 2 kernels and optimize the calculation of topk_indices (#134)
Co-authored-by: chengxiaokang <chengxiaokang@baidu.com>
2026-01-22 10:29:28 +08:00
yuqilinaa
c9f00c132c [Kernel] Enable fast random sample on Kunlun3 Platform with generators (#73)
Co-authored-by: Xinyu Dong <dongxinyu03@baidu.com>
2026-01-20 21:49:33 +08:00
baoqian426
2512259944 longcontext chunk make attention crash, fix it (#117)
Co-authored-by: root <root@rdtest-node1150.bcc-zwlt.baidu.com>
2026-01-17 18:38:23 +08:00
fromck
71a5a04e0a [Misc]Specify that DS32 only supports --kv-cache-dtype bfloat16 (#119)
* [Kernel] add kernels to torch.ops

* [Misc]Specify that DS only supports --kv-cache-dtype bfloat16

---------

Co-authored-by: chengxiaokang <chengxiaokang@baidu.com>
2026-01-17 16:52:02 +08:00
wzh
115eb32068 enable int8 bmm 2026-01-14 14:30:59 +08:00
baoqian426
fb424acca7 Merge pull request #106 from baoqian426/enable-full-cudagraph-deepseek
enable full cudagraph for deepseek
2026-01-13 09:57:56 +08:00
Jin Hanyu
bd90350968 [Bug] Fix no apply_top_k_top_p issue. (#101) 2026-01-12 16:38:03 +08:00
hanhaowen
ff8ebfa208 enable full cudagraph for deepseek 2026-01-12 15:18:12 +08:00
dongxinyu03
26b311ccf5 [Feature] DeepSeek Support MTP 2026-01-06 21:37:21 +08:00
baoqian426
ee0f50e68f [Feature] support deepseek v3/r1/v3.2 (#78)
* [Feature] support deepseek v3/r1/v3.2

* fix gpt_oss

* update readme

* update readme

---------

Co-authored-by: hanhaowen <hanhaowen@baidu.com>
2026-01-05 22:55:35 +08:00
hanhaowen
b015bb76fd remove qwen2.py llama.py fix llama output 2025-12-31 11:39:37 +08:00
Xinyu Dong
b3c30a3cb9 [Feature] Support XiaoMi MIMO Flash V2 (#62)
* [Feature] Support MIMO Flash V2
2025-12-31 10:16:33 +08:00
ldh2020
58c1db5073 [Bugfix] fix the bug of the flash_attention in Qwen3-Next 2025-12-21 10:34:43 +08:00
chenyili0619
2e2933d217 [Bug] Fixed the issue where an error occurred when the request included a seed. 2025-12-18 13:03:34 +08:00
baoqian426
fae22c2e62 Merge pull request #3 from xyDong0223/main
[Kernel] Enable fast random sample on Kunlun3 Platform
2025-12-11 11:47:30 +08:00
xyDong0223
af2cd6097f [Kernell] fix miss import os 2025-12-11 11:17:28 +08:00
xyDong0223
670c2397b8 [Kernel] Enable fast random sample on Kunlun P 2025-12-10 21:52:48 +08:00
chenyili
7c22d621fb 提交vllm0.11.0开发分支 2025-12-10 17:51:24 +08:00
dongxinyu03
c728e52505 Initial commit for vLLM-Kunlun Plugin 2025-12-10 12:05:39 +08:00