PGFLMG b7cd743038 [Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949)

2025-08-06 23:49:36 -07:00

..

cache_controller.py

[bugfix] fix import path in HiCacheController (#8749)

2025-08-03 22:19:15 -07:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[feat] support minimum token load balance in dp attention (#7379)

2025-08-03 00:46:47 -07:00

detokenizer_manager.py

Support v1/responses and use harmony in serving_chat (#8837)

2025-08-06 16:20:34 -07:00

io_struct.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

mm_utils.py

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292)

2025-08-06 23:21:40 -07:00

multimodal_processor.py

vlm: optimize tensor transport (#6003)

2025-07-26 17:41:01 +08:00

schedule_batch.py

[Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949)

2025-08-06 23:49:36 -07:00

schedule_policy.py

Fix: resolve prefill of retracted request out-of-memory issue when ignore_eos is enabled (#7434)

2025-08-02 14:43:45 +08:00

scheduler_input_blocker.py

Support colocating requests (#7973)

2025-07-28 22:51:49 -07:00

scheduler_metrics_mixin.py

Split the scheduler into multiple mixin classes to reduce the file size (#8483)

2025-07-29 12:46:50 -07:00

scheduler_output_processor_mixin.py

Support v1/responses and use harmony in serving_chat (#8837)

2025-08-06 16:20:34 -07:00

scheduler_profiler_mixin.py

Split the scheduler into multiple mixin classes to reduce the file size (#8483)

2025-07-29 12:46:50 -07:00

scheduler_update_weights_mixin.py

Split the scheduler into multiple mixin classes to reduce the file size (#8483)

2025-07-29 12:46:50 -07:00

scheduler.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

session_controller.py

Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748)

2025-07-04 16:33:33 -07:00

template_manager.py

Enables force reasoning based on chat template for Qwen3-Thinking (#8369)

2025-08-06 20:02:47 -07:00

tokenizer_manager.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

tp_worker_overlap_thread.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

tp_worker.py

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

utils.py

[feat] support minimum token load balance in dp attention (#7379)

2025-08-03 00:46:47 -07:00