Lianmin Zheng 2854a5ea9f Fix the overhead due to penalizer in bench_latency (#1496)

2024-09-23 07:38:14 -07:00

..

lora

[Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433)

2024-09-15 12:46:04 -07:00

launch_tgi.sh

Add OpenAI backend to the CI test (#869)

2024-08-01 09:25:24 -07:00

load_tokenizer.py

Add OpenAI backend to the CI test (#869)

2024-08-01 09:25:24 -07:00

reference_hf.py

Fix the overhead due to penalizer in bench_latency (#1496)

2024-09-23 07:38:14 -07:00