Shan Yu cd10654e7e [Feat] Support update weights without restart server (#1157)

2024-08-20 13:48:24 -07:00

..

models

[Feat] Add window attention for gemma-2 (#1056)

2024-08-13 17:01:26 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

run_suite.py

Re-organize CI tests (#1052)

2024-08-12 03:39:01 -07:00

test_chunked_prefill.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_embedding_openai_server.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_eval_accuracy_large_chunked_prefill.py

Fix CI accuracy && time out limit (#1133)

2024-08-16 21:41:11 -07:00

test_eval_accuracy_large_mixed_chunked_prefill.py

Fix CI accuracy && time out limit (#1133)

2024-08-16 21:41:11 -07:00

test_eval_accuracy_large.py

Fix CI accuracy && time out limit (#1133)

2024-08-16 21:41:11 -07:00

test_eval_accuracy_mini.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_large_max_new_tokens.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_models_from_modelscope.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_moe_serving_throughput.py

Enable chunked prefill by default (#1040)

2024-08-14 21:56:20 -07:00

test_openai_server.py

feat: allow streaming for multi-prompt and/or parallel sampling (#1134)

2024-08-20 08:06:55 -07:00

test_serving_throughput.py

Enable chunked prefill by default (#1040)

2024-08-14 21:56:20 -07:00

test_skip_tokenizer_init.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_srt_endpoint.py

feat: allow streaming for multi-prompt and/or parallel sampling (#1134)

2024-08-20 08:06:55 -07:00

test_torch_compile.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_triton_attn_backend.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00

test_update_weights.py

[Feat] Support update weights without restart server (#1157)

2024-08-20 13:48:24 -07:00

test_vision_openai_server.py

ci: add moe test (#1053)

2024-08-13 18:43:23 +10:00