Lianmin Zheng 722530fa01 Enable overlap scheduler by default for the triton attention backend (#2105)

2024-11-20 02:58:35 -08:00

..

data_parallel_controller.py

Launch dp ranks in parallel (#2053)

2024-11-16 17:39:39 -08:00

detokenizer_manager.py

[feat] Add session control (#2073)

2024-11-20 00:36:53 -08:00

image_processor.py

Unify the model type checking (#1905)

2024-11-03 12:25:39 -08:00

io_struct.py

[feat] Add session control (#2073)

2024-11-20 00:36:53 -08:00

schedule_batch.py

[feat] Add session control (#2073)

2024-11-20 00:36:53 -08:00

schedule_policy.py

Fix chunked prefill with output logprob (#2083)

2024-11-18 13:16:28 -08:00

scheduler.py

Enable overlap scheduler by default for the triton attention backend (#2105)

2024-11-20 02:58:35 -08:00

session_controller.py

[feat] Add session control (#2073)

2024-11-20 00:36:53 -08:00

tokenizer_manager.py

[feat] Add session control (#2073)

2024-11-20 00:36:53 -08:00

tp_worker_overlap_thread.py

Enable overlap scheduler by default for the triton attention backend (#2105)

2024-11-20 02:58:35 -08:00

tp_worker.py

Use cuda event wait and synchronization instead of busy waiting (#2089)

2024-11-19 00:21:46 -08:00