Lianmin Zheng 14b6493087 Delete the useless test/srt/test_throughput.py (#1045)

2024-08-11 21:31:52 -07:00

..

models

fix: force max new tokens to be 1 for embedding request (#1019)

2024-08-10 13:46:42 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

run_suite.py

Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

test_chunked_prefill.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_embedding_openai_server.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_eval_accuracy.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_large_max_new_tokens.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_models_from_modelscope.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_openai_server.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_serving_throughput.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_skip_tokenizer_init.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_srt_endpoint.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_torch_compile.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_vision_openai_server.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00