Files
xc-llm-ascend/vllm_ascend
zhenwenqi2024 ddd475d5be [ModelRunner] apply_grammer uses vllm function (#4974)
### What this PR does / why we need it?
this pr removes apply_gramme in npu_model_runner. we change logits to
cpu, and do the same thing with gpu_model_runner.
it may change the performance, we will change it after torch.compile is
supported with npu inductor

- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9

---------

Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
2025-12-16 15:26:01 +08:00
..
2025-12-02 22:10:52 +08:00
2025-12-11 18:45:43 +08:00
2025-12-02 17:35:47 +08:00