Files
sglang/sgl-kernel/python/sgl_kernel/attention.py

8 lines
203 B
Python
Raw Normal View History

import torch
def lightning_attention_decode(q, k, v, past_kv, slope, output, new_kv):
2025-03-27 19:09:58 -07:00
torch.ops.sgl_kernel.lightning_attention_decode.default(
q, k, v, past_kv, slope, output, new_kv
)