Scott Lee b6fb5d7666 Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

cache_controller.py

feat(hicache): Support passing prefix keys for l3 store. (#9045)

2025-10-10 00:22:05 -07:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

Improve dp attention port assignment scheme (#5889)

2025-10-12 17:55:59 -07:00

detokenizer_manager.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

mm_utils.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

multi_tokenizer_mixin.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

multimodal_processor.py

Fix multimodal registry and code sync scripts (#10759)

2025-09-22 15:36:01 -07:00

overlap_utils.py

Beta spec-overlap for EAGLE (#11398)

2025-10-12 11:02:22 +08:00

schedule_batch.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

schedule_policy.py

[Feature] Support mamba radix cache v0 (#11214)

2025-10-12 20:57:15 -07:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_metrics_mixin.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

scheduler_output_processor_mixin.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

scheduler_profiler_mixin.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_update_weights_mixin.py

Remove tp_worker.worker (#11548)

2025-10-13 22:38:48 +08:00

scheduler.py

Adjust overlap event loop (#11507)

2025-10-14 00:33:19 +08:00

session_controller.py

Fix DP load for embedding (#9165)

2025-08-15 23:58:44 -07:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

Introduce naming convention in io_struct and base sglang io classes. (#10133)

2025-10-03 10:55:13 +08:00

tokenizer_manager.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

tp_worker.py

Adjust overlap event loop (#11507)

2025-10-14 00:33:19 +08:00

utils.py

Remove dp balance metadata and minimul token balance. (#11170)

2025-10-03 01:48:15 +08:00