Zhang Junda 0b2aa8a70c Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) ...

Co-authored-by: hnyls2002 <lsyincs@gmail.com>

2025-10-02 10:51:25 +08:00

..

ascend

[Feature]feat(get_ip): unify get_ip_xxx (#10081)

2025-09-18 22:35:26 -07:00

base

[Vulnerability]feat(conn): set bootstrap server host (#9931)

2025-09-05 17:36:17 +08:00

common

[PD] Extract the PP transfer layer calculate logic from Mooncake to Common backend (#10565)

2025-09-28 00:10:41 +08:00

fake

[1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169)

2025-09-09 12:27:55 +08:00

mooncake

[PD] Extract the PP transfer layer calculate logic from Mooncake to Common backend (#10565)

2025-09-28 00:10:41 +08:00

nixl

fix(disagg): fix sending KV cache in case of MLA for NIXL backend (#10673)

2025-09-20 00:30:10 -07:00

decode_kvcache_offload_manager.py

[PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192)

2025-09-25 23:20:49 -07:00

decode_schedule_batch_mixin.py

Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720)

2025-10-02 10:51:25 +08:00

decode.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

kv_events.py

feat: add dp-rank to KV events (#6852)

2025-06-04 15:29:34 -07:00

mini_lb.py

Simplify Router arguments passing and build it in docker image (#9964)

2025-09-05 12:13:55 +08:00

prefill.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00

utils.py

Fix metrics and request tracing (TimeStats) (#11123)

2025-10-01 13:03:07 -07:00