whx
|
29aaba5f84
|
[Perf][MTP] Optimize reject sampler in greedy situation. (#2137)
This PR port optimization in PR #2002 to main and makes it cleaner.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/afa5b7ca0b417abadfa85e32f28969b72e58a885
---------
Signed-off-by: whx-sjtu <2952154980@qq.com>
|
2025-08-11 17:37:49 +08:00 |
|
sherie
|
126cdfc92b
|
[Test] add rejection sampler ut (#2084)
### What this PR does / why we need it?
add rejection sampler ut.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
UT passed
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/586f286789a09f5616be74ee8bedde0a9f698a72
Signed-off-by: wangxiaoxin-sherie <wangxiaoxin7@huawei.com>
|
2025-08-05 19:03:36 +08:00 |
|
wangxiyuan
|
9b67c87b14
|
[Refactor]Refactor sampler (#2050)
Refactor Sampler implementation from patch way to inherit from vLLM
Sampler interface.
Next step: Make the op `TopKTopPSampler` in vLLM support custom ops
register mechanism
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/61a6905ab036fd00eafdb1b0ca130d5feccfe686
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2025-07-30 08:47:22 +08:00 |
|