whx
|
6464c97ff9
|
[BugFix][v0.11.0] Fix quantization related mtp bug with patch (#3619)
vLLM 0.11.0 didn't bring PR
(https://github.com/vllm-project/vllm/pull/25805) thus missing the
prefix of mtp's SharedHead. This PR fixes this bug with a patch to
vllm's deepseek_mtp.
---------
Signed-off-by: whx-sjtu <2952154980@qq.com>
|
2025-10-22 23:06:09 +08:00 |
|