Lianmin Zheng d1a0863251 Add a test case for cached_tokens (#3145)

2025-01-26 01:39:28 -08:00

..

cache_controller.py

Cache controller for hierarchical caching (#2804)

2025-01-10 20:22:01 -08:00

configure_logging.py

Fix the request loggings to make it fully able to be easily replayed (#2973)

2025-01-18 21:45:00 -08:00

data_parallel_controller.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

detokenizer_manager.py

[#2812] Make the decode status dict capcity adjustable by a CLI param (#2839)

2025-01-19 11:36:53 -08:00

image_processor.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

io_struct.py

[Doc] Update doc of custom logit processor (#3021)

2025-01-20 16:50:25 -08:00

schedule_batch.py

Add a test case for cached_tokens (#3145)

2025-01-26 01:39:28 -08:00

schedule_policy.py

Query remaining memory dynamically for PrefillAdder (#2941)

2025-01-17 20:20:26 -08:00

scheduler.py

Add a test case for cached_tokens (#3145)

2025-01-26 01:39:28 -08:00

session_controller.py

[Feature] Add sampler custom logits processor (#2396)

2025-01-19 14:46:53 -08:00

tokenizer_manager.py

Update TypeBasedDispatcher and balance CI tests (#3001)

2025-01-19 23:37:27 -08:00

tp_worker_overlap_thread.py

Enable CPU device on SGLang (#2806)

2025-01-16 21:22:53 -08:00

tp_worker.py

fix missing revision arg when loading tokenizer (#2982)

2025-01-19 11:36:07 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00