Fix typo of VLLM_ASCEND_ENABLE_TOPK_OPTIMIZE (#1112)
### What this PR does / why we need it? Fix typo of VLLM_ASCEND_ENABLE_TOPK_OPTIMIZE ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? CI passed Signed-off-by: linfeng-yuan <1102311262@qq.com>
This commit is contained in:
@@ -97,5 +97,5 @@ def topk_topp_forward_native(
|
||||
|
||||
|
||||
Sampler.apply_min_p = apply_min_p
|
||||
if envs.VLLM_ASCEND_ENABLE_TOPK_OPTIMZE:
|
||||
if envs.VLLM_ASCEND_ENABLE_TOPK_OPTIMIZE:
|
||||
TopKTopPSampler.forward_native = topk_topp_forward_native
|
||||
|
||||
Reference in New Issue
Block a user