Stefan He 3774f07825 Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099)

2025-06-19 00:56:37 -07:00

..

base

Minor PD style fix (#7215)

2025-06-15 16:12:12 -07:00

common

Minor PD style fix (#7215)

2025-06-15 16:12:12 -07:00

fake

Minor PD style fix (#7215)

2025-06-15 16:12:12 -07:00

mooncake

[PD] Add custom memory pool option to support Mooncake PD with NVLink (#7264)

2025-06-17 17:21:37 -07:00

nixl

Minor PD style fix (#7215)

2025-06-15 16:12:12 -07:00

decode_schedule_batch_mixin.py

[PD] Support structured output (#6560)

2025-05-23 21:49:00 -07:00

decode.py

Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099)

2025-06-19 00:56:37 -07:00

kv_events.py

feat: add dp-rank to KV events (#6852)

2025-06-04 15:29:34 -07:00

launch_lb.py

PD Rust LB (PO2) (#6437)

2025-05-29 20:50:10 +08:00

mini_lb.py

Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096)

2025-06-19 02:28:15 +08:00

prefill.py

[PD] use int32 for kv indices & get num_reserved_decode_tokens from server_args (#7214)

2025-06-15 11:51:03 -07:00

utils.py

[PD] Add custom memory pool option to support Mooncake PD with NVLink (#7264)

2025-06-17 17:21:37 -07:00