Lianmin Zheng 0fafc5606b port fp8 mixtral (#460)

2024-05-21 11:46:35 -07:00

..

backend

Rename api_num_spec_tokens -> num_api_spec_tokens (#458)

2024-05-20 18:44:23 -07:00

lang

Rename api_num_spec_tokens -> num_api_spec_tokens (#458)

2024-05-20 18:44:23 -07:00

srt

port fp8 mixtral (#460)

2024-05-21 11:46:35 -07:00

test

Rename api_num_spec_tokens -> num_api_spec_tokens (#458)

2024-05-20 18:44:23 -07:00

__init__.py

Update version to 0.1.16 (#438)

2024-05-13 17:29:17 -07:00

api.py

Rename api_num_spec_tokens -> num_api_spec_tokens (#458)

2024-05-20 18:44:23 -07:00

global_config.py

Handle truncation errors (#436)

2024-05-13 15:56:00 -07:00

launch_server_llavavid.py

support llava video (#426)

2024-05-13 16:57:00 -07:00

launch_server.py

support llava video (#426)

2024-05-13 16:57:00 -07:00

utils.py

Use model loader from vllm (#459)

2024-05-21 09:13:37 -07:00