Lianmin Zheng 2bcfba1b08 Skip unnecessary penalizer (#1707)

2024-10-18 17:54:03 -07:00

..

configs

minor: fix config (#1524)

2024-09-27 01:49:16 -07:00

constrained

[FIX] Catch syntax error of Regex Guide to avoid crash (#1521)

2024-09-28 12:42:06 -07:00

layers

Simplify flashinfer utilities (#1704)

2024-10-17 22:54:14 -07:00

lora

Use is_flashinfer_available to replace is_hip for flashinfer check (#1596)

2024-10-06 22:54:05 -07:00

managers

Skip unnecessary penalizer (#1707)

2024-10-18 17:54:03 -07:00

mem_cache

Skip unnecessary penalizer (#1707)

2024-10-18 17:54:03 -07:00

model_executor

Skip unnecessary penalizer (#1707)

2024-10-18 17:54:03 -07:00

models

Fix mixed batch for multi modal models (#1702)

2024-10-17 10:27:26 -07:00

openai_api

Add matched_stop token or str to distinguish between eos or stop str finish_reason generation (#1684)

2024-10-17 18:06:52 +00:00

sampling

Skip unnecessary penalizer (#1707)

2024-10-18 17:54:03 -07:00

conversation.py

Add image_token in conversation.py (#1632)

2024-10-11 05:07:51 -07:00

hf_transformers_utils.py

[Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510)

2024-09-24 21:37:33 -07:00

mm_utils.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

server_args.py

Returning a per request metric for number of cached_tokens read (#1599)

2024-10-16 11:49:22 -07:00

server.py

Fix engine unit test (#1701)

2024-10-17 09:53:32 -07:00

utils.py

Add date to logging messages (#1623) (#1679)

2024-10-16 18:54:55 -07:00