wangxiyuan
|
9b67c87b14
|
[Refactor]Refactor sampler (#2050)
Refactor Sampler implementation from patch way to inherit from vLLM
Sampler interface.
Next step: Make the op `TopKTopPSampler` in vLLM support custom ops
register mechanism
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/61a6905ab036fd00eafdb1b0ca130d5feccfe686
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2025-07-30 08:47:22 +08:00 |
|