Lianmin Zheng 2a02185c5f Rename DP_RANK to SGLANG_DP_RANK (#2218)

2024-11-27 09:36:36 -08:00

..

data_parallel_controller.py

Expose max total num tokens from Runtime & Engine API (#2092)

2024-11-22 15:10:10 -08:00

detokenizer_manager.py

Fix flasky tests (#2212)

2024-11-26 23:06:20 -08:00

image_processor.py

[feat] Support session control for vision language models (#2210)

2024-11-27 00:03:29 -08:00

io_struct.py

Input_embeds support (#2052)

2024-11-25 16:35:04 -08:00

schedule_batch.py

[feat] Support session control for vision language models (#2210)

2024-11-27 00:03:29 -08:00

schedule_policy.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

scheduler.py

Rename DP_RANK to SGLANG_DP_RANK (#2218)

2024-11-27 09:36:36 -08:00

session_controller.py

[feat] Support session control for vision language models (#2210)

2024-11-27 00:03:29 -08:00

tokenizer_manager.py

Input_embeds support (#2052)

2024-11-25 16:35:04 -08:00

tp_worker_overlap_thread.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

tp_worker.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00