EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[v0.11.0][Perf] Eliminating the zerolike operator through patch (#3632)

Browse Source 
### What this PR does / why we need it?
There is a zero-like operator before the attention operation in each
decoding stage. After analysis, this operator can be eliminated. The
purpose of this PR is to remove this operator and improve performance.

---------

Signed-off-by: ZYang6263 <zy626375@gmail.com>
This commit is contained in:
ZYang6263
2025-10-23 14:49:28 +08:00
committed by GitHub
parent 74903af460
commit 6975d46627
9 changed files with 111 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
vllm_ascend/patch/worker/__init__.py
View File

@@ -28,3 +28,4 @@ import vllm_ascend.patch.worker.patch_weight_loader # noqa
import vllm_ascend.patch.worker.patch_multimodal_merge # noqa
import vllm_ascend.patch.worker.patch_minicpm # noqa
import vllm_ascend.patch.worker.patch_deepseek_mtp # noqa
import vllm_ascend.patch.worker.patch_attention_layer # noqa