### What this PR does / why we need it?
Add kv pool developer guide
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
vLLM version: v0.11.0rc3
vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
- vLLM version: v0.11.0
- vLLM main:
83f478bb19
---------
Signed-off-by: Pz1116 <zpbzpb123123@gmail.com>
Signed-off-by: pz1116 <zpbzpb123123@gmail.com>
308 B
308 B
Feature Guide
This section provides an overview of the features implemented in vLLM Ascend. Developers can refer to this guide to understand how vLLM Ascend works.
:::{toctree} :caption: Feature Guide :maxdepth: 1 patch ModelRunner_prepare_inputs Multi_Token_Prediction ACL_Graph KV_Cache_Pool_Guide :::