kk 7a5e6ce1cb Fix GPU OOM (#6564) ...

Co-authored-by: michael <michael.zhang@amd.com>

2025-05-24 16:38:39 -07:00

..

triton_ops

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

aiter_backend.py

Fix GPU OOM (#6564)

2025-05-24 16:38:39 -07:00

base_attn_backend.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

cutlass_mla_backend.py

Cutlass MLA decode - fix dtype error (#5868)

2025-04-28 21:12:58 -07:00

double_sparsity_backend.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

flashattention_backend.py

[OAI] Add rid tracing for v1/embeddings and fix rid type in Chat (#6397)

2025-05-18 13:05:38 -07:00

flashinfer_backend.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

flashinfer_mla_backend.py

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109)

2025-05-15 00:48:09 -07:00

flashmla_backend.py

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109)

2025-05-15 00:48:09 -07:00

merge_state.py

feat: Add a unified merge_state API (#5428)

2025-05-05 10:32:33 -07:00

torch_native_backend.py

Feat/support encoder model (like bert) (#4887)

2025-04-17 01:50:48 -07:00

triton_backend.py

[doc] add note for get_num_kv_splits in triton_backend (#6444)

2025-05-19 21:40:21 -07:00

utils.py

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109)

2025-05-15 00:48:09 -07:00

vision.py

refactor: minor refactors regarding multimodal processing (#6187)

2025-05-17 22:53:20 -07:00