[Bug_fix] fix torchair o_proj forward parameter (#4166)
### What this PR does / why we need it? In `torchair_mla.py`, the `self.oproj` function includes an additional parameter `is_force_scatter`, while the `AscendRowParallelLinear` function in `linear.py` does not add this parameter. - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 Signed-off-by: zzhx1 <zzh_201018@outlook.com>
This commit is contained in:
@@ -299,7 +299,7 @@ class AscendRowParallelLinear(RowParallelLinear):
|
|||||||
def forward(
|
def forward(
|
||||||
self,
|
self,
|
||||||
input_,
|
input_,
|
||||||
is_prefill: bool = True,
|
**kwargs,
|
||||||
) -> Union[torch.Tensor, tuple[torch.Tensor, Optional[Parameter]]]:
|
) -> Union[torch.Tensor, tuple[torch.Tensor, Optional[Parameter]]]:
|
||||||
if self.custom_op is not None:
|
if self.custom_op is not None:
|
||||||
return self.custom_op.apply(input_)
|
return self.custom_op.apply(input_)
|
||||||
|
|||||||
Reference in New Issue
Block a user