weijinqian0 a6ef3ac4e4 [Performance] Pre-issued exponential distribution operator. (#4908) ...

Pre-issued exponential distribution operator.

Result:
Single inference saves 200-300 microseconds.
before：

<img width="2257" height="1058" alt="2"
src="https://github.com/user-attachments/assets/c1da19e2-a439-42cb-9d7c-c0218e61fd4c"
/>

After：

<img width="2211" height="342" alt="image"
src="https://github.com/user-attachments/assets/03c84292-c802-4755-949c-4266a9a72fc0"
/>


- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c

---------

Signed-off-by: weijinqian_v1 <weijinqian@huawei.com>
Co-authored-by: weijinqian_v1 <weijinqian@huawei.com>

2025-12-11 23:02:51 +08:00

..

logits_processor

[performance] Enhance performance after enabling min_p (#4529)

2025-12-02 20:35:51 +08:00

__init__.py

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

rejection_sampler.py

Fixed the performance degradation issue in post-processing in speculative decoding scenarios. (#4849)

2025-12-10 20:32:44 +08:00

sampler.py

[Performance] Pre-issued exponential distribution operator. (#4908)

2025-12-11 23:02:51 +08:00