2 Commits

Author	SHA1	Message	Date
fems14	1c9f0fe26f	Fix of DeepSeek Error in KV Pool Mixed Deployment Scenario (#3087) ... ### What this PR does / why we need it? A new kv_role "kv_both" is added to run mixed deployment scenarios. The mixed deployment will involve a decode phase, where with_prefill should be false. ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: v0.10.2 - vLLM main: c60e6137f0 Signed-off-by: fems14 <1804143737@qq.com>	2025-09-22 20:36:41 +08:00
Chao Lei	cef43b524e	[Feat] A Connector that supports Mooncake store (#2913) ... ### What this PR does / why we need it? Added a new connector for Mooncake store integration to enable kvcache reuse in scenarios with system prompts or multi-turn dialogues. ### How was this patch tested? - vLLM version: v0.10.2 - vLLM main: 5963b98b46 --------- Signed-off-by: LCAIZJ <leichao139636@163.com> Signed-off-by: fems14 <1804143737@qq.com> Co-authored-by: fems14 <1804143737@qq.com> Co-authored-by: Dreamerleader <2270923832@qq.com> Co-authored-by: Pz1116 <zpbzpb123123@gmail.com> Co-authored-by: lizy124 <1950471827@qq.com> Co-authored-by: zouyida2052 <zouyida2002@gmail.com>	2025-09-18 14:04:45 +08:00