weijinqian0 a6ef3ac4e4 [Performance] Pre-issued exponential distribution operator. (#4908) ...

Pre-issued exponential distribution operator.

Result:
Single inference saves 200-300 microseconds.
before：

<img width="2257" height="1058" alt="2"
src="https://github.com/user-attachments/assets/c1da19e2-a439-42cb-9d7c-c0218e61fd4c"
/>

After：

<img width="2211" height="342" alt="image"
src="https://github.com/user-attachments/assets/03c84292-c802-4755-949c-4266a9a72fc0"
/>


- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c

---------

Signed-off-by: weijinqian_v1 <weijinqian@huawei.com>
Co-authored-by: weijinqian_v1 <weijinqian@huawei.com>

2025-12-11 23:02:51 +08:00

..

logits_processor

[main] add pd transfer for ascend scheduler (#2753)

2025-09-10 08:46:39 +08:00

test_rejection_sampler.py

[UT] Fix test_sample_recovered_tokens_pytorch_autoregressive (#3434)

2025-10-24 11:20:57 +08:00

test_sampler.py

[Performance] Pre-issued exponential distribution operator. (#4908)

2025-12-11 23:02:51 +08:00