Lianmin Zheng c76040e31b Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

..

image_processors

model: Support Janus-pro (#3203)

2025-03-12 11:02:11 -07:00

cache_controller.py

Hierarchical Caching Refactoring and Fixing TP issue (#4082)

2025-03-12 11:22:35 -07:00

configure_logging.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

data_parallel_controller.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

detokenizer_manager.py

[Minor] more code cleanup (#4077)

2025-03-04 21:23:47 -08:00

image_processor.py

refactor: move image processors to separate files (#4229)

2025-03-11 12:35:35 -07:00

io_struct.py

Add Support for Qwen2-VL Multi-modal Embedding Models (#3694)

2025-03-06 16:46:20 -08:00

multi_modality_padding.py

refactor: move image processors to separate files (#4229)

2025-03-11 12:35:35 -07:00

schedule_batch.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

schedule_policy.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

scheduler_output_processor_mixin.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

scheduler.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

session_controller.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

tokenizer_manager.py

Add Support for Qwen2-VL Multi-modal Embedding Models (#3694)

2025-03-06 16:46:20 -08:00

tp_worker_overlap_thread.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

tp_worker.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00