Georgi Gerganov 7b53389c24 metal : add memory pool for temp allocs (#12850) ...

* metal : add memory pool for temp allocs (wip) [no ci]

* cont : free buffers from the heap

* cont : resize heap [no ci]

* cont : refactor heap [no ci]

* cont : heap for each cmd buffer [no ci]

* cont : fix free

* wip

* cont : fix alignment [no ci]

* cont : not working .. [no ci]

* cont : heap allocation now works [no ci]

* cont : use MTLHeapTypePlacement

ggml-ci

* metal : use dynamic MTLHeap allocations

ggml-ci

* metal : add comments

* metal : disable softmax use of mem_pool

ggml-ci

* metal : final touches

2025-04-22 16:15:51 +03:00

..

ggml-blas

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cann

CANN: Add support for async operator submission (#12864)

2025-04-17 20:34:16 +08:00

ggml-cpu

ggml : add SSE 4.2 and x64 base variant for CPUs without AVX (#12871)

2025-04-21 18:13:51 +02:00

ggml-cuda

graph : make FA compatible with MLA + add initial Metal kernels (#12953)

2025-04-17 18:16:36 +03:00

ggml-hip

CUDA/HIP: Share the same unified memory allocation logic. (#12934)

2025-04-15 11:20:38 +02:00

ggml-kompute

llama : add Qwen2VL support + multimodal RoPE (#10361)

2024-12-14 14:43:46 +02:00

ggml-metal

metal : add memory pool for temp allocs (#12850)

2025-04-22 16:15:51 +03:00

ggml-musa

cuda : enable CUDA Graph on CUDA Toolkit < 12.x (#12394)

2025-03-17 20:25:13 +02:00

ggml-opencl

opencl: fix incorrect local_size index in profiling log (#12868)

2025-04-16 14:25:57 -07:00

ggml-rpc

rpc : add RPC_CMD_HELLO (#12955)

2025-04-18 10:13:42 +03:00

ggml-sycl

SYCL: Add non-contiguous support in ROPE (#12993)

2025-04-21 19:13:30 +05:30

ggml-vulkan

vulkan: support noncontiguous rms_norm (#13031)

2025-04-20 10:50:02 +02:00

CMakeLists.txt

ggml : add SSE 4.2 and x64 base variant for CPUs without AVX (#12871)

2025-04-21 18:13:51 +02:00

ggml-alloc.c

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend-impl.h

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend-reg.cpp

ggml-backend : fix backend search path (#12330)

2025-03-11 14:25:17 +01:00

ggml-backend.cpp

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ggml-common.h

musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc (#12611)

2025-03-30 10:59:38 +02:00

ggml-impl.h

ggml: don't include arm_neon.h when using CUDA 12 with ARM Neon (ggml/1187)

2025-04-11 00:17:47 +03:00

ggml-opt.cpp

ggml-opt: fix data corruption (ggml/1022)

2024-11-21 09:22:02 +02:00

ggml-quants.c

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ggml-quants.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

ggml : add bilinear upscale support (ggml/1185)

2025-04-11 00:17:47 +03:00

gguf.cpp

Fix clang warning in gguf_check_reserved_keys (#12686)

2025-04-01 13:12:53 +02:00