Chao Lei a486ff8c11 KVCache Transfer via Layer-wise Strategy in Disaggregation (#2602) ...

### What this PR does / why we need it?
See RFC: https://github.com/vllm-project/vllm-ascend/issues/2470 This PR
add a new kv connector for layer-wised kv transfer

### Does this PR introduce _any_ user-facing change?
yes, a new kv connector is added. User can use layer wised feature now.
### How was this patch tested?


- vLLM version: v0.11.0rc3
- vLLM main:
https://github.com/vllm-project/vllm/commit/releases/v0.11.0

---------

Signed-off-by: leichao.lc <leichao139636@163.com>
Signed-off-by: CaveNightingale <2859066733@qq.com>
Signed-off-by: nwpu-zxr <zhouxuerong2@huawei.com>
Signed-off-by: wangxiaoteng <wangxiaoteng@huawei.com>
Signed-off-by: hanxinlong <50882499@qq.com>
Signed-off-by: liziyu <liziyu16@huawei.com>
Co-authored-by: CaveNightingale <2859066733@qq.com>
Co-authored-by: nwpu-zxr <zhouxuerong2@huawei.com>
Co-authored-by: wangxiaoteng <wangxiaoteng@huawei.com>
Co-authored-by: hanxinlong <50882499@qq.com>

2025-09-30 15:10:29 +08:00

..

attention

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

compilation

[Refactor][Graph] Move graph parameter logic to acl_graph module (#3101)

2025-09-22 22:23:14 +08:00

core

[BugFix] Fix ascend scheduler assert error (#3191)

2025-09-28 18:22:08 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

KVCache Transfer via Layer-wise Strategy in Disaggregation (#2602)

2025-09-30 15:10:29 +08:00

eplb

FlashLB algorithm (#3042)

2025-09-23 10:27:14 +08:00

lora

[Bugfix][LoRA] Fix forward error and shape mismatch when using LoRA (#3153)

2025-09-28 17:30:50 +08:00

models

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

multistream

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

ops

[Quickfix] Fix dp+ep+tp error when sp chunked the hidden_states (#3246)

2025-09-29 09:12:49 +08:00

patch

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

quantization

[main][quantization] Support deepseek w4a8 per-channel quantization (#3011)

2025-09-27 21:01:16 +08:00

sample

Add restriction conditions to the ApplyTopPTopK operator (#3254)

2025-09-29 14:04:58 +08:00

spec_decode

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

torchair

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

worker

[Aclgraph][DP] Fix dp dummy run not in aclgraph error (#3208)

2025-09-30 11:14:51 +08:00

__init__.py

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

ascend_config.py

KVCache Transfer via Layer-wise Strategy in Disaggregation (#2602)

2025-09-30 15:10:29 +08:00

ascend_forward_context.py

[bugfix] Fix warning bug: model config is None. (#3238)

2025-09-29 09:44:49 +08:00

envs.py

Add DeepSeek V3.2 support (#3270)

2025-09-30 03:25:58 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

[Doc] Release note for v0.11.0rc0 (#3224)

2025-09-30 03:26:18 +08:00

utils.py

[bugfix] Fix warning bug: model config is None. (#3238)

2025-09-29 09:44:49 +08:00