### What this PR does / why we need it? Optimize rope by caching sin and cos at the first layer in Qwen Models. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.10.1.1 - vLLM main: https://github.com/vllm-project/vllm/commit/562663a044acbff0b8df11e07a4929b18d71172f --------- Signed-off-by: MengqingCao <cmq0113@163.com> Signed-off-by: ZYang6263 <zy626375@gmail.com> Signed-off-by: rjg-lyh <1318825571@qq.com> Co-authored-by: Mengqing Cao <cmq0113@163.com> Co-authored-by: ZYang6263 <51255902183@stu.ecnu.edu.cn> Co-authored-by: ZYang6263 <zy626375@gmail.com>