Ying Sheng 32f6144323 fix: Fix returned prefill logits and add output str test (#1046)

2024-08-12 06:13:45 +00:00

..

models

fix: Fix returned prefill logits and add output str test (#1046)

2024-08-12 06:13:45 +00:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

run_suite.py

Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

test_chunked_prefill.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_embedding_openai_server.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_eval_accuracy.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_large_max_new_tokens.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_models_from_modelscope.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_openai_server.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_serving_throughput.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_skip_tokenizer_init.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_srt_endpoint.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_torch_compile.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00

test_vision_openai_server.py

Improve end-to-end throughput test and its coverage (#1039)

2024-08-11 18:27:33 -07:00