Ying Sheng 51fda1439f Update Readme (#660) ...

Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

2024-07-19 09:54:01 -07:00

..

constrained

Format (#593)

2024-07-05 10:06:17 -07:00

layers

refactor model loader [unreachable code]: initial refactor (#655)

2024-07-19 09:27:06 -07:00

managers

TokenizerManager.context_len should inherit from `server_args.conte… (#654)

2024-07-18 21:55:29 -07:00

model_loader

refactor model loader [unreachable code]: initial refactor (#655)

2024-07-19 09:27:06 -07:00

models

misc: add pre-commit config (#637)

2024-07-17 11:55:39 -07:00

conversation.py

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

flush_cache.py

Improve doc strings (#518)

2024-06-08 02:39:32 -07:00

hf_transformers_utils.py

Format (#593)

2024-07-05 10:06:17 -07:00

memory_pool.py

feat: add check_env (#645)

2024-07-17 21:39:28 -07:00

mm_utils.py

Handle grayscale images in expand2square (#97)

2024-01-24 16:23:11 -08:00

model_config.py

Fix Llava model (#594)

2024-07-06 00:58:46 -07:00

openai_api_adapter.py

Fix streaming (#600)

2024-07-07 01:55:58 -07:00

openai_protocol.py

feat: add benchmark serving (#657)

2024-07-19 09:15:21 -07:00

sampling_params.py

SamplingParams add "spaces_between_special_tokens" argument (#392)

2024-04-30 16:17:12 -07:00

server_args.py

Update Readme (#660)

2024-07-19 09:54:01 -07:00

server.py

Update Readme (#660)

2024-07-19 09:54:01 -07:00

utils.py

Remove cached triton launcher (#656)

2024-07-18 23:28:40 -07:00