Enrique Shockwave f11eb90fe4 Initialize model_worker_batch variable (#1973)

2024-11-09 11:28:02 -08:00

..

configs

fix black in pre-commit (#1940)

2024-11-08 07:42:47 +08:00

constrained

[Performance] Support both xgrammar and outlines for constrained decoding (#1752)

2024-10-25 21:47:02 +00:00

layers

[Performance, Triton Kernel Args] extend_attention, optimize kern args to _fwd_kernel (#1941)

2024-11-07 18:24:02 -08:00

lora

Update vllm to 0.6.3 (#1711) (#1720)

2024-10-19 20:45:41 -07:00

managers

Initialize model_worker_batch variable (#1973)

2024-11-09 11:28:02 -08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

Fix metrics (#1963)

2024-11-08 23:21:11 -08:00

model_executor

[minor] Improve code style and compatibility (#1961)

2024-11-08 02:19:41 -08:00

models

Adjust reward model's score module and pooler module order for reducing computation (#1956)

2024-11-08 00:10:54 -08:00

openai_api

Simplify tokenizer manager (#1904)

2024-11-03 08:38:26 -08:00

sampling

Remove the useless to_srt_kwargs (#1955)

2024-11-07 23:15:08 -08:00

conversation.py

Llama3.2 vision model support (#1551)

2024-10-21 15:01:21 -07:00

hf_transformers_utils.py

Let reward model take text inputs instead of message lists (#1907)

2024-11-03 13:27:12 -08:00

mm_utils.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

server_args.py

[minor] Improve code style and compatibility (#1961)

2024-11-08 02:19:41 -08:00

server.py

Fix metrics (#1963)

2024-11-08 23:21:11 -08:00

utils.py

[minor] Improve code style and compatibility (#1961)

2024-11-08 02:19:41 -08:00