YAMY 5a9170d993 Optimize copy_kv_cache for spec decoding (#11126) ...

Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

2025-10-08 10:43:30 +08:00

..

cpp_radix_tree

[Feature] Radix Tree in C++ (#7369)

2025-08-02 19:50:14 -07:00

storage

fix 3fs indices (#10855)

2025-10-04 00:06:38 +08:00

allocator_ascend.py

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

allocator.py

EAGLE cache fix for SWARadixCache (#11231)

2025-10-07 18:21:37 +08:00

base_prefix_cache.py

Refactors radix cache for extra key support (#10317)

2025-09-22 02:16:16 +08:00

chunk_cache.py

Clean match_prefix and prepare_for_extend for mem cache V2 (#11200)

2025-10-07 17:54:18 -07:00

evict_policy.py

[HICache] introduce evict policy (#10190)

2025-09-18 11:10:20 +08:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hicache_storage.py

refactor zero copy (#10300)

2025-09-22 15:17:31 -07:00

hiradix_cache.py

EAGLE cache fix for HiCache (#11215)

2025-10-04 16:53:53 -07:00

memory_pool_host.py

[HiCache] Cleaning the deprecated host memory state (#10778)

2025-09-25 14:43:53 +08:00

memory_pool.py

Optimize copy_kv_cache for spec decoding (#11126)

2025-10-08 10:43:30 +08:00

multimodal_cache.py

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292)

2025-08-06 23:21:40 -07:00

radix_cache_cpp.py

Refactors radix cache for extra key support (#10317)

2025-09-22 02:16:16 +08:00

radix_cache.py

EAGLE cache fix for SWARadixCache (#11231)

2025-10-07 18:21:37 +08:00

swa_radix_cache.py

EAGLE cache fix for SWARadixCache (#11231)

2025-10-07 18:21:37 +08:00