Georgi Gerganov 06658ad7c3 metal : separate scale and mask from QKT in FA kernel (#9189) ...

* metal : separate scale and mask from QKT in FA kernel

* metal : ne01 check no longer necessary

* metal : keep data in local memory

2024-08-26 18:31:02 +03:00

..

cmake

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

include

CPU/CUDA: Gemma 2 FlashAttention support (#8542)

2024-08-24 21:34:59 +02:00

src

metal : separate scale and mask from QKT in FA kernel (#9189)

2024-08-26 18:31:02 +03:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00