Liangsheng Yin 3694f8f996 Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

..

models

[Feat] Add window attention for gemma-2 (#1056)

2024-08-13 17:01:26 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

run_suite.py

Re-organize CI tests (#1052)

2024-08-12 03:39:01 -07:00

test_chunked_prefill.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_embedding_openai_server.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_eval_accuracy_large_chunked_prefill.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_eval_accuracy_large_mixed_chunked_prefill.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_eval_accuracy_large.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_eval_accuracy_mini.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_large_max_new_tokens.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_models_from_modelscope.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_moe_serving_throughput.py

Enable chunked prefill by default (#1040)

2024-08-14 21:56:20 -07:00

test_openai_server.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_serving_throughput.py

Enable chunked prefill by default (#1040)

2024-08-14 21:56:20 -07:00

test_skip_tokenizer_init.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_srt_endpoint.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_torch_compile.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_triton_attn_backend.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_vision_openai_server.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00