kyleliang-nv dd445a41f5 [feature] Add start step profile argument in /start_profile (#7608)

2025-07-09 18:42:15 -07:00

..

multimodal_processors

add model: qwen2-audio (#7596)

2025-07-04 21:13:10 -07:00

cache_controller.py

Kernels for efficient KV cache IO (#7313)

2025-07-06 22:53:36 -07:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

feat: add direct routing strategy to DP worker (#6884)

2025-06-09 11:44:05 -07:00

detokenizer_manager.py

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

io_struct.py

[feature] Add start step profile argument in /start_profile (#7608)

2025-07-09 18:42:15 -07:00

mm_utils.py

Fix llama4 vision (#7840)

2025-07-08 14:00:03 -07:00

multimodal_processor.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

schedule_batch.py

fix duplicate args in schedule_batch (#7816)

2025-07-07 01:31:03 -07:00

schedule_policy.py

Fix prefill OOM due to wrong token calculation when page > 1 (#7397)

2025-06-24 02:12:29 +08:00

scheduler_output_processor_mixin.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

scheduler.py

[feature] Add start step profile argument in /start_profile (#7608)

2025-07-09 18:42:15 -07:00

session_controller.py

Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748)

2025-07-04 16:33:33 -07:00

template_manager.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

tokenizer_manager.py

[feature] Add start step profile argument in /start_profile (#7608)

2025-07-09 18:42:15 -07:00

tp_worker_overlap_thread.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

tp_worker.py

[RL] support update_weights_from_distributed with different group and multiple weights (#7292)

2025-07-02 19:29:11 -07:00

utils.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00