Lianmin Zheng ac2387279e Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988) ...

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

2025-03-03 00:12:04 -08:00

..

sglang

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

pyproject.toml

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00