Optimize number of index selections of sin/cos cache. - vLLM version: v0.10.0 - vLLM main: https://github.com/vllm-project/vllm/commit/656c24f1b5d8a662e9ec391503d146341def5f18 Signed-off-by: whx-sjtu <2952154980@qq.com>
Optimize number of index selections of sin/cos cache. - vLLM version: v0.10.0 - vLLM main: https://github.com/vllm-project/vllm/commit/656c24f1b5d8a662e9ec391503d146341def5f18 Signed-off-by: whx-sjtu <2952154980@qq.com>