Lianmin Zheng 2e6e62e156 Increase the number of thread limitation for tp worker managers. (#567)

2024-06-26 09:33:45 -07:00

..

__init__.py

Allow running with vllm==0.4.3 (#561)

2024-06-24 15:24:21 -07:00

base_cache.py

Fix BaseCache metric (#170)

2024-02-08 17:23:09 -08:00

fsm_cache.py

Increase the number of thread limitation for tp worker managers. (#567)

2024-06-26 09:33:45 -07:00

jump_forward.py

Fix the Jump-Forward with Chinese (#551)

2024-06-16 21:45:04 +08:00