EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[CI][Bugfix] Fix scheduleroutput has no attr get error in prompt logprobs (#4998)

Browse Source 
### What this PR does / why we need it?
Fix scheduleroutput has no attr get error in prompt logprobs

Fix
https://github.com/vllm-project/vllm-ascend/actions/runs/20194753373/job/57977131870

### How was this patch tested?
CI passed with existing test.

- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c

Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
Mengqing Cao
2025-12-15 11:10:39 +08:00
committed by GitHub
parent 2497bbbaf6
commit 6beb4434e1
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm_ascend/worker/model_runner_v1.py
View File

@@ -1762,7 +1762,7 @@ class NPUModelRunner(GPUModelRunner):
# Compute prompt logprobs if needed. # Compute prompt logprobs if needed.
prompt_logprobs_dict = self._get_prompt_logprobs_dict( prompt_logprobs_dict = self._get_prompt_logprobs_dict(
hidden_states[:scheduler_output.total_num_scheduled_tokens], hidden_states[:scheduler_output.total_num_scheduled_tokens],
scheduler_output, scheduler_output.num_scheduled_tokens,
) )
num_sampled_tokens = sampler_output.sampled_token_ids.shape[0] num_sampled_tokens = sampler_output.sampled_token_ids.shape[0]