Commit Graph

5 Commits

Author SHA1 Message Date
baoqian426
2512259944 longcontext chunk make attention crash, fix it (#117)
Co-authored-by: root <root@rdtest-node1150.bcc-zwlt.baidu.com>
2026-01-17 18:38:23 +08:00
fromck
71a5a04e0a [Misc]Specify that DS32 only supports --kv-cache-dtype bfloat16 (#119)
* [Kernel] add kernels to torch.ops

* [Misc]Specify that DS only supports --kv-cache-dtype bfloat16

---------

Co-authored-by: chengxiaokang <chengxiaokang@baidu.com>
2026-01-17 16:52:02 +08:00
wzh
115eb32068 enable int8 bmm 2026-01-14 14:30:59 +08:00
hanhaowen
ff8ebfa208 enable full cudagraph for deepseek 2026-01-12 15:18:12 +08:00
baoqian426
ee0f50e68f [Feature] support deepseek v3/r1/v3.2 (#78)
* [Feature] support deepseek v3/r1/v3.2

* fix gpt_oss

* update readme

* update readme

---------

Co-authored-by: hanhaowen <hanhaowen@baidu.com>
2026-01-05 22:55:35 +08:00