Lianmin Zheng 2e6e62e156 Increase the number of thread limitation for tp worker managers. (#567)

2024-06-26 09:33:45 -07:00

..

launch_tgi.sh

release initial code

2024-01-08 04:37:50 +00:00

load_tokenizer.py

Increase the number of thread limitation for tp worker managers. (#567)

2024-06-26 09:33:45 -07:00

reference_hf.py

Add sglang.bench_latency for offline benchmark (#564)

2024-06-25 03:38:04 -07:00