Lianmin Zheng ad82bac6f5 Fix model loading & format code (#125)

2024-01-30 23:49:52 -08:00

..

constrained

Add cache metrics (#119)

2024-01-30 22:13:14 -08:00

layers

Return logprob for choices (#87)

2024-01-23 05:07:30 -08:00

managers

Fix model loading & format code (#125)

2024-01-30 23:49:52 -08:00

models

Fix model loading & format code (#125)

2024-01-30 23:49:52 -08:00

backend_config.py

Json Decode && Mutl-Turns (#4)

2024-01-15 00:49:29 -08:00

conversation.py

[Feature] Adds basic support for image content in OpenAI chat routes (#113)

2024-01-30 06:12:33 -08:00

hf_transformers_utils.py

release initial code

2024-01-08 04:37:50 +00:00

memory_pool.py

release initial code

2024-01-08 04:37:50 +00:00

mm_utils.py

Handle grayscale images in expand2square (#97)

2024-01-24 16:23:11 -08:00

model_config.py

Suppport qwen model and solve some problems (#75)

2024-01-22 20:14:51 -08:00

sampling_params.py

Json Decode && Mutl-Turns (#4)

2024-01-15 00:49:29 -08:00

server_args.py

[Feature] Allow specifying all ports to use in advance (#116)

2024-01-30 08:34:51 -08:00

server.py

format code

2024-01-30 16:36:10 +00:00

utils.py

format code

2024-01-30 16:36:10 +00:00