Optimize number of index selections of sin/cos cache.
- vLLM version: v0.10.0
- vLLM main:
656c24f1b5
Signed-off-by: whx-sjtu <2952154980@qq.com>
Optimize number of index selections of sin/cos cache.
- vLLM version: v0.10.0
- vLLM main:
656c24f1b5
Signed-off-by: whx-sjtu <2952154980@qq.com>