Mengqing Cao 449f8f65a7 [KV-Sharing] Support KV-Sharing feature in CLA models (#4138) ...

### What this PR does / why we need it?
Support KV-Sharing feature in CLA (cross layer attention) models, which
sharing kv cache in some layers.

- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c
---------
Signed-off-by: MengqingCao <cmq0113@163.com>

2025-12-23 10:48:31 +08:00

..

_cann_ops_custom

[Kernel] add custom op GmmSwigluQuantWeightNzTensorList (#3804)

2025-11-28 18:06:39 +08:00

attention

[KV-Sharing] Support KV-Sharing feature in CLA models (#4138)

2025-12-23 10:48:31 +08:00

compilation

[feature] support pcp + mtp in full graph (#4572)

2025-12-22 16:13:39 +08:00

core

[CI] fix lint (#5216)

2025-12-20 17:03:25 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[Bugfix] Use hf_text_config instead of hf_config to support multimodal PD-Disaggregated (#5205)

2025-12-22 20:21:45 +08:00

eplb

[Misc] Cleanup useless print and logger (#5220)

2025-12-22 11:28:26 +08:00

kv_offload

upgrade vLLM to main (#4608)

2025-12-02 22:10:52 +08:00

lora

[BugFix]Fix precision issue for LoRA feature (#4141)

2025-12-19 14:22:06 +08:00

model_loader

[CI] speed up ut (#4901)

2025-12-11 18:45:43 +08:00

ops

[CustomOp] Register AscendApplyRotaryEmb CustomOp and remove related patch (#4667)

2025-12-23 10:04:37 +08:00

patch

[CustomOp] Register AscendApplyRotaryEmb CustomOp and remove related patch (#4667)

2025-12-23 10:04:37 +08:00

quantization

[refactor] Remove unnecessary attributes from set_ascend_forward_context (#5204)

2025-12-23 08:49:52 +08:00

sample

[Performance] Add async exponential while model executing (#4501)

2025-12-20 21:23:21 +08:00

spec_decode

[Refactor] move the metadata from attention_v1 to util(ready for extract common_cp) & realize Ascendmetadata inherit from the parent class. (#5203)

2025-12-23 00:10:52 +08:00

worker

[KV-Sharing] Support KV-Sharing feature in CLA models (#4138)

2025-12-23 10:48:31 +08:00

xlite

[Feat]Xlite Qwen3-vl Support (#5228)

2025-12-22 16:30:52 +08:00

__init__.py

clean up model module (#4611)

2025-12-02 17:35:47 +08:00

ascend_config.py

[Performance] Add async exponential while model executing (#4501)

2025-12-20 21:23:21 +08:00

ascend_forward_context.py

[refactor] Remove unnecessary attributes from set_ascend_forward_context (#5204)

2025-12-23 08:49:52 +08:00

cpu_binding.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

envs.py

[Main] [Patch] support balance scheduling patch (#5212)

2025-12-23 09:04:38 +08:00

flash_common3_context.py

[Perf]enable prefill flashcommon3 (#4065)

2025-12-14 09:34:13 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

[Feat]Xlite Qwen3-vl Support (#5228)

2025-12-22 16:30:52 +08:00

profiling_config.py

Drop ascend scheduler (#4623)

2025-12-05 09:03:45 +08:00

utils.py

[CustomOp] Register AscendApplyRotaryEmb CustomOp and remove related patch (#4667)

2025-12-23 10:04:37 +08:00