[docs] Add kv pool developer guide (#3752)
### What this PR does / why we need it?
Add kv pool developer guide
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
vLLM version: v0.11.0rc3
vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
- vLLM version: v0.11.0
- vLLM main:
83f478bb19
---------
Signed-off-by: Pz1116 <zpbzpb123123@gmail.com>
Signed-off-by: pz1116 <zpbzpb123123@gmail.com>
This commit is contained in:
@@ -9,4 +9,5 @@ patch
|
||||
ModelRunner_prepare_inputs
|
||||
Multi_Token_Prediction
|
||||
ACL_Graph
|
||||
KV_Cache_Pool_Guide
|
||||
:::
|
||||
|
||||
Reference in New Issue
Block a user