ApsarasX 87975fa058 [Bugfix] Fix early return in CustomDeepseekV2MoE.forward during profile_run (#682) ...

### What this PR does / why we need it?

Fix #674 to avoild KVCache overallocation and OOM risks.

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

Signed-off-by: ApsarasX <apsarax@outlook.com>

2025-04-29 17:06:19 +08:00

..

attention

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

core

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

device_allocator

catch ImportError when C code not compiled (#575)

2025-04-18 18:11:49 +08:00

distributed

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

[Bugfix] Fix early return in CustomDeepseekV2MoE.forward during profile_run (#682)

2025-04-29 17:06:19 +08:00

ops

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

patch

[MTP] follow custom deepseek modeling changes to support graph mode (#636)

2025-04-28 21:18:53 +08:00

quantization

support deepseek quant & mix-parallel with graphmode (#585)

2025-04-23 16:23:25 +08:00

worker

[MTP] follow custom deepseek modeling changes to support graph mode (#636)

2025-04-28 21:18:53 +08:00

__init__.py

[Bugfix] Fix triton placeholder patch period (#704)

2025-04-28 18:52:03 +08:00

envs.py

[MISC] Make vllm version configurable (#651)

2025-04-28 14:19:06 +08:00

platform.py

[V1] Make V1 engine backward compatible (#637)

2025-04-24 17:20:11 +08:00

utils.py

[MISC] Make vllm version configurable (#651)

2025-04-28 14:19:06 +08:00