Lianmin Zheng d84c5e70f7 Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

..

models

fix: force max new tokens to be 1 for embedding request (#1019)

2024-08-10 13:46:42 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

run_suite.py

Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

test_chunked_prefill.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_embedding_openai_server.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_eval_accuracy.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_large_max_new_tokens.py

Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

test_models_from_modelscope.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_openai_server.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_skip_tokenizer_init.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_srt_endpoint.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_torch_compile.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_vision_openai_server.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00