KV cache manger has been changed by https://github.com/vllm-project/vllm/commit/f8a1a2d108d290791ae1245b2ee309f38fdd7619 This PR adapt the change into vllm-ascend to make ci happy Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
KV cache manger has been changed by https://github.com/vllm-project/vllm/commit/f8a1a2d108d290791ae1245b2ee309f38fdd7619 This PR adapt the change into vllm-ascend to make ci happy Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>