Lianmin Zheng 66301e124f Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

..

cache_controller.py

Hierarchical Caching for SGLang (#2693)

2025-02-23 21:56:30 -08:00

configure_logging.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

data_parallel_controller.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

detokenizer_manager.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

image_processor.py

Revert "Rename TokenizerManager to StdOrchestrator" (#3828)

2025-02-24 14:47:59 -08:00

io_struct.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

schedule_batch.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

schedule_policy.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

scheduler.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

session_controller.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

tokenizer_manager.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

tp_worker_overlap_thread.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

tp_worker.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00