Wenxuan Tan 0f587e80d3 Use Tensor Core Decode when gqa group size >= 4 (#8624) ...

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-08-22 23:25:15 +08:00

..

triton_ops

Fix swa eagle verify accuracy for Triton backend (#9279)

2025-08-17 12:52:02 -07:00

wave_ops

[AMD] Support Wave attention backend with AMD GPU optimizations (#8660)

2025-08-12 13:49:11 -07:00

aiter_backend.py

refine aiter_backend for mtp (#7279)

2025-08-08 11:06:02 -07:00

ascend_backend.py

[feature] Ascend NPU graph support (#9399)

2025-08-20 21:13:27 -07:00

base_attn_backend.py

DP Enhancement (#8280)

2025-07-24 21:36:21 -07:00

cutlass_mla_backend.py

[bugfix] Fix page size for create_flashmla_kv_indices_triton() for cutlass mla (#8685)

2025-08-01 14:28:04 -07:00

double_sparsity_backend.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

dual_chunk_flashattention_backend.py

[Fix] Fix dual chunk model default behavior (#9032)

2025-08-11 23:50:23 -07:00

flashattention_backend.py

Support MHA with chunked prefix cache for flashinfer/flashmla backend, support page size > 1 for MHA chunked prefix (#8616)

2025-08-21 18:19:44 -07:00

flashinfer_backend.py

Use Tensor Core Decode when gqa group size >= 4 (#8624)

2025-08-22 23:25:15 +08:00

flashinfer_mla_backend.py

Support MHA with chunked prefix cache for flashinfer/flashmla backend, support page size > 1 for MHA chunked prefix (#8616)

2025-08-21 18:19:44 -07:00

flashmla_backend.py

feat: mtp support dp-attention (#6081)

2025-06-17 00:33:28 -07:00

hybrid_attn_backend.py

Clean up server_args.py to have a dedicated function for model specific adjustments (#8983)

2025-08-08 19:56:50 -07:00

intel_amx_backend.py

Add intel_amx backend for Radix Attention for CPU (#6408)

2025-05-30 21:37:42 -07:00

merge_state.py

feat: Add a unified merge_state API (#5428)

2025-05-05 10:32:33 -07:00

tbo_backend.py

feat: support compatibility between MTP and two-batch-overlap (#7225)

2025-06-27 01:10:27 -07:00

torch_native_backend.py

Add intel_amx backend for Radix Attention for CPU (#6408)

2025-05-30 21:37:42 -07:00

triton_backend.py

Fix triton backend eagle illegal memory access (#9344)

2025-08-19 20:16:26 -07:00

trtllm_mha_backend.py

Support speculative decoding in the trtllm_mha attention backend (#9331)

2025-08-21 23:53:35 -07:00

trtllm_mla_backend.py

Enables speculative decoding for the trtllm_mla attention backend (#9238)

2025-08-21 01:18:21 -07:00

utils.py

Add Support for Page Size greater than 1 for Flashinfer MLA Backend (#8593)

2025-08-21 18:15:06 -07:00

vision_utils.py

[GLM4.1V and GLM4.5V] Add vision transformer num_dummy_head support: max tp=4 -> max tp=8 (#9059)

2025-08-18 14:40:13 -07:00

vision.py

minor: determine mm attn backend based on platforms (#9303)

2025-08-22 01:08:41 -07:00

wave_backend.py

[AMD] Support Wave attention backend with AMD GPU optimizations (#8660)

2025-08-12 13:49:11 -07:00