Mingyi a523a3c13a Reduce hardcoded logic of kernel usage (#707)

2024-07-23 16:42:21 -07:00

..

constrained

Format (#593)

2024-07-05 10:06:17 -07:00

layers

Reduce hardcoded logic of kernel usage (#707)

2024-07-23 16:42:21 -07:00

managers

Reduce hardcoded logic of kernel usage (#707)

2024-07-23 16:42:21 -07:00

model_loader

refactor model loader: initial refactor (#664)

2024-07-20 02:18:22 -07:00

models

Update vllm version to support llama3.1 (#705)

2024-07-23 13:49:34 -07:00

openai_api

Update OpenAI API (#667)

2024-07-19 23:20:54 -07:00

conversation.py

Update OpenAI API (#667)

2024-07-19 23:20:54 -07:00

flush_cache.py

Improve doc strings (#518)

2024-06-08 02:39:32 -07:00

hf_transformers_utils.py

Update vllm version to support llama3.1 (#705)

2024-07-23 13:49:34 -07:00

memory_pool.py

Decouple kv (#679)

2024-07-20 14:16:45 -07:00

mm_utils.py

Handle grayscale images in expand2square (#97)

2024-01-24 16:23:11 -08:00

model_config.py

Fix Llava model (#594)

2024-07-06 00:58:46 -07:00

sampling_params.py

Add support for OpenAI API parallel sampling (#640)

2024-07-19 23:10:01 -07:00

server_args.py

Use min new token ratio at start (#701)

2024-07-23 11:52:50 -07:00

server.py

Update vllm version to support llama3.1 (#705)

2024-07-23 13:49:34 -07:00

utils.py

Support Deepseek MoE Model (#689)

2024-07-21 03:09:29 -07:00