hucong 7ea17fbee3 [0.11.0][BugFix] Improve the performance of prefixcache features (#4021) ...

### What this PR does / why we need it?
cherry-pick from https://github.com/vllm-project/vllm-ascend/pull/4022

The code bug caused an empty bubble. When the npu_paged_cache_load
operator was called, it forcibly transferred seq_len2 to the device,
which triggered synchronization and interrupted the CPU operator's
launch stream.


---------

Signed-off-by: underfituu <hzhucong@163.com>

2025-11-10 11:51:34 +08:00

..

models

[BugFix] Fix torchair+mtp bug after deleting deepseek_mtp. (#3590)

2025-10-21 22:23:52 +08:00

ops

[v0.11.0] [Bugfix] [MoE]fix error in deepseek when using allgather (#3827)

2025-10-30 14:59:46 +08:00

quantization

[Feat][quantization] Support new version w4a8 dynamic quantization for Linear layers (#3311)

2025-10-21 20:18:39 +08:00

__init__.py

[1/4][Refactor] Refactor torchair worker (#1885)

2025-07-21 11:50:46 +08:00

torchair_attention.py

[v0.11.0][Perf] Eliminating the zerolike operator through patch (#3632)

2025-10-23 14:49:28 +08:00

torchair_mla.py

[0.11.0][BugFix] Improve the performance of prefixcache features (#4021)

2025-11-10 11:51:34 +08:00

torchair_model_runner.py

fix bug when max_seqs=14 in mtp=2 scenario and raise error when cudagraph_capture_sizes can't be an integer multiple of uniform_decode_query_len (#3909)

2025-10-31 09:25:06 +08:00

torchair_sfa.py

[v0.11.0][Perf] Eliminating the zerolike operator through patch (#3632)

2025-10-23 14:49:28 +08:00

torchair_worker.py

[CI] Upgrade vllm to newest commit (#3182)

2025-09-26 06:18:15 +08:00

utils.py

[v0.11.0] [Bugfix] [MoE]fix error in deepseek when using allgather (#3827)

2025-10-30 14:59:46 +08:00