Lianmin Zheng 751c3a037c Fix dp print message (#2138)

2024-11-23 01:22:26 -08:00

..

configs

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

constrained

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

layers

[CI] Fix test cases (#2137)

2024-11-23 01:00:07 -08:00

lora

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

managers

Fix dp print message (#2138)

2024-11-23 01:22:26 -08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_executor

[CI] Fix test cases (#2137)

2024-11-23 01:00:07 -08:00

models

Add simple CPU offloading support. (#2081)

2024-11-23 06:23:53 +00:00

openai_api

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampling

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

[minor] Clean up unused imports (#2122)

2024-11-22 01:50:42 -08:00

server_args.py

Add simple CPU offloading support. (#2081)

2024-11-23 06:23:53 +00:00

server.py

Expose max total num tokens from Runtime & Engine API (#2092)

2024-11-22 15:10:10 -08:00

utils.py

Add simple CPU offloading support. (#2081)

2024-11-23 06:23:53 +00:00