[Bug_fix] fix torchair o_proj forward parameter (#4166)
### What this PR does / why we need it? In `torchair_mla.py`, the `self.oproj` function includes an additional parameter `is_force_scatter`, while the `AscendRowParallelLinear` function in `linear.py` does not add this parameter. - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 Signed-off-by: zzhx1 <zzh_201018@outlook.com>
This commit is contained in:
@@ -299,7 +299,7 @@ class AscendRowParallelLinear(RowParallelLinear):
|
||||
def forward(
|
||||
self,
|
||||
input_,
|
||||
is_prefill: bool = True,
|
||||
**kwargs,
|
||||
) -> Union[torch.Tensor, tuple[torch.Tensor, Optional[Parameter]]]:
|
||||
if self.custom_op is not None:
|
||||
return self.custom_op.apply(input_)
|
||||
|
||||
Reference in New Issue
Block a user