zhaomingyu13 52d9086f64 [Bugfix] Fix the acceptance rates dorp issue when applying eagle3 to QuaRot model (#6914) ...

### What this PR does / why we need it?
When using the target model after rotational quantization, the
acceptance rate decreases because the fc weight of the draft model has
not undergone rotational quantization(issue: #6445). We fixed this issue
by performing rotation quantization on the fc weight of the draft model
in the same way as the main model when loading draft model.

- vLLM version: v0.16.0
- vLLM main:
15d76f74e2

Signed-off-by: zhaomingyu <zhaomingyu13@h-partners.com>

2026-03-04 11:29:49 +08:00

..

platform

[Main2Main] Upgrade vLLM to 0226 (#6813)

2026-02-27 16:05:21 +08:00

worker

[Bugfix] Fix the acceptance rates dorp issue when applying eagle3 to QuaRot model (#6914)

2026-03-04 11:29:49 +08:00

__init__.py

[Bugfix] Fix the acceptance rates dorp issue when applying eagle3 to QuaRot model (#6914)

2026-03-04 11:29:49 +08:00