Lianmin Zheng c51020cf0c Fix the chat template for llava-v1.6-34b & format code (#177)

2024-02-11 05:50:13 -08:00

..

bench_llama_low_api.py

Fix the chat template for llava-v1.6-34b & format code (#177)

2024-02-11 05:50:13 -08:00

reference_hf.py

release initial code

2024-01-08 04:37:50 +00:00

test_llama_extend.py

Improve the control of streaming and improve the first token latency in streaming (#117)

2024-01-29 17:05:42 -08:00

test_llama_low_api.py

release initial code

2024-01-08 04:37:50 +00:00

test_llava_low_api.py

Improve the control of streaming and improve the first token latency in streaming (#117)

2024-01-29 17:05:42 -08:00