rjg-lyh 7a205dbaa8 [main] Optimize rope in Qwen Models (#2571) ...

### What this PR does / why we need it?
Optimize rope by caching sin and cos at the first layer in Qwen Models.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
CI passed with new added/existing test.


- vLLM version: v0.10.1.1
- vLLM main:
562663a044

---------

Signed-off-by: MengqingCao <cmq0113@163.com>
Signed-off-by: ZYang6263 <zy626375@gmail.com>
Signed-off-by: rjg-lyh <1318825571@qq.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: ZYang6263 <51255902183@stu.ecnu.edu.cn>
Co-authored-by: ZYang6263 <zy626375@gmail.com>

2025-09-09 14:28:14 +08:00

..

e2e

[main] flashcomm_v1 optim in Qwen Dense Models (#2802)

2025-09-08 22:52:24 +08:00

ut

[main] Optimize rope in Qwen Models (#2571)

2025-09-09 14:28:14 +08:00

__init__.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00