Enrique Shockwave f11eb90fe4 Initialize model_worker_batch variable (#1973)

2024-11-09 11:28:02 -08:00

..

data_parallel_controller.py

Simplify tokenizer manager (#1904)

2024-11-03 08:38:26 -08:00

detokenizer_manager.py

Fix possible ZMQ hanging (#1800)

2024-10-25 23:07:07 -07:00

image_processor.py

Unify the model type checking (#1905)

2024-11-03 12:25:39 -08:00

io_struct.py

fix black in pre-commit (#1940)

2024-11-08 07:42:47 +08:00

schedule_batch.py

fix black in pre-commit (#1940)

2024-11-08 07:42:47 +08:00

schedule_policy.py

support prometheus metrics (#1853)

2024-11-05 20:42:53 -08:00

scheduler.py

Initialize model_worker_batch variable (#1973)

2024-11-09 11:28:02 -08:00

tokenizer_manager.py

[minor] Improve code style and compatibility (#1961)

2024-11-08 02:19:41 -08:00

tp_worker_overlap_thread.py

Fix logprob in the overlapped mode (#1795)

2024-10-25 11:06:57 -07:00

tp_worker.py

Unify the model type checking (#1905)

2024-11-03 12:25:39 -08:00