[Bugfix][Aclgraph] failed to update graph task (#4282)
### What this PR does / why we need it? bugfix the error of full graph aclgraph Signed-off-by: chenmenglong <chenmenglong1@huawei.com>
This commit is contained in:
@@ -278,7 +278,8 @@ def update_mla_attn_params(update_stream, forward_context, runtime_shape,
|
|||||||
else:
|
else:
|
||||||
seq_lens_list = seq_lens_list + [0] * (runtime_shape -
|
seq_lens_list = seq_lens_list + [0] * (runtime_shape -
|
||||||
len(seq_lens_list))
|
len(seq_lens_list))
|
||||||
torch.npu.graph_task_update_begin(update_stream, handle)
|
|
||||||
|
torch.npu.graph_task_update_begin(update_stream, handle)
|
||||||
|
|
||||||
torch_npu.npu_fused_infer_attention_score.out(
|
torch_npu.npu_fused_infer_attention_score.out(
|
||||||
q_nope,
|
q_nope,
|
||||||
|
|||||||
Reference in New Issue
Block a user