Lianmin Zheng bb0e8a32b5 Clean up server args (#8161)

2025-07-19 11:32:52 -07:00

..

multimodal_processors

refactor: unify names of the feature field of MultimodalDataItem (#8075)

2025-07-16 17:52:38 -07:00

cache_controller.py

Hicache Storage Layer Prototype (#7704)

2025-07-18 15:20:19 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

feat: add direct routing strategy to DP worker (#6884)

2025-06-09 11:44:05 -07:00

detokenizer_manager.py

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

io_struct.py

[Doc] Steps to add a new attention backend (#8155)

2025-07-18 16:38:26 -07:00

mm_utils.py

Fix flaky CI: test_vlm_models (#8006)

2025-07-14 14:56:41 -07:00

multimodal_processor.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

schedule_batch.py

Feat: Support audio in Phi4-mm model (#8048)

2025-07-18 21:03:53 -07:00

schedule_policy.py

SWA Prefix Cache (#7367)

2025-07-13 12:31:07 -07:00

scheduler_output_processor_mixin.py

feat: add tp_rank, pp_rank and dp_rank labels for scheduler metrics (#7597)

2025-07-16 17:55:59 -07:00

scheduler.py

Clean up server args (#8161)

2025-07-19 11:32:52 -07:00

session_controller.py

Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748)

2025-07-04 16:33:33 -07:00

template_manager.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

tokenizer_manager.py

[health_generate] fix: fix the /health_generate always success bug (#8028)

2025-07-18 22:08:46 -07:00

tp_worker_overlap_thread.py

SWA Prefix Cache (#7367)

2025-07-13 12:31:07 -07:00

tp_worker.py

Revert "Fix different device type adjustment in PP" (#8141)

2025-07-18 01:12:11 -07:00

utils.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00