EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' (#11009)

Browse Source
This commit is contained in:
YanbingJiang
2025-09-28 15:31:08 +08:00
committed by GitHub
parent 5519766a4d
commit 66face3598
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
python/sglang/srt/layers/rotary_embedding.py
View File

@@ -206,6 +206,7 @@ class RotaryEmbedding(CustomOp):
query: torch.Tensor, query: torch.Tensor,
key: torch.Tensor, key: torch.Tensor,
offsets: Optional[torch.Tensor] = None, offsets: Optional[torch.Tensor] = None,
fused_set_kv_buffer_arg=None,
) -> Tuple[torch.Tensor, torch.Tensor]: ) -> Tuple[torch.Tensor, torch.Tensor]:
positions = torch.add(positions, offsets) if offsets is not None else positions positions = torch.add(positions, offsets) if offsets is not None else positions
if _is_cpu_amx_available: if _is_cpu_amx_available: