Lianmin Zheng ac2387279e Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988) ...

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

2025-03-03 00:12:04 -08:00

..

example_image.png

Fix logit processor bugs (#427)

2024-05-12 04:54:07 -07:00

run_suite.py

Temporarily skip the openai frontend tests (#3151)

2025-01-26 04:17:35 -08:00

test_anthropic_backend.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_bind_cache.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_choices.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_litellm_backend.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_openai_backend.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_srt_backend.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

test_tracing.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_vertexai_backend.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00