sherie 908a851a77 optimize the funtion of computing topk and topp in sampler. (#970) ...

### What this PR does / why we need it?
Optimize the performance of calculation logic in sampler and deepseekv2.

### Does this PR introduce _any_ user-facing change?
Added VLLM_ENABLE_TOPK_OPTIMZE config in sampler

### How was this patch tested?
pytest test_sampler.py

Signed-off-by: wangxiaoxin (A) <wangxiaoxin7@huawei.com>
Co-authored-by: wangxiaoxin (A) <wangxiaoxin7@huawei.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>

2025-06-05 16:42:18 +08:00

..

test_dynamic_npugraph_batchsize.py

[Misc] Refactor additional_config (#1029)

2025-06-05 16:28:01 +08:00

test_ilama_lora_tp2.py

[V1][LoRA][Test] V1 Engine LoRA support & e2e test (#893)

2025-05-22 19:20:51 +08:00

test_offline_inference_distributed.py

optimize the funtion of computing topk and topp in sampler. (#970)

2025-06-05 16:42:18 +08:00

test_pyhccl_distributed.py

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00