Files
xc-llm-ascend/vllm_ascend
zouyida2052 2b4f7a5016 [cherry-pick pr-4254] bugfix for mtp>1 when lm_head_tp>1 (#4360)
### What this PR does / why we need it?
Previously, the dummy run executed compute_logits only once, regardless
of num_speculative_tokens. This caused execute_model to hang on
compute_logits when lm head tensor parallelism exceeded 1. The fix
ensures compute_logits executes correctly during dummy run, matching
num_speculative_tokens.

Signed-off-by: zouyida2052 <zouyida2002@gmail.com>
2025-12-01 11:11:15 +08:00
..
2025-11-29 15:19:11 +08:00
2025-11-28 17:32:25 +08:00
2025-11-29 15:19:11 +08:00
2025-10-09 10:28:38 +08:00
2025-11-29 15:19:11 +08:00
2025-11-28 17:32:25 +08:00