Sync from v0.13

Browse Source

...

This commit is contained in:

xiezhongtao

2026-01-19 10:38:50 +08:00

parent b2ef04d792

commit 5aef6c175a

3714 changed files with 854317 additions and 89342 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

docs/assets/design/hybrid_kv_cache_manager/basic_grouping_example.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 24 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/full_attn.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.0 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/memory_layout.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 62 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/overview.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 39 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/sw_attn.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.5 KiB