fj-y-saito c67cc9837d ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227) ...

* Add SVE support for q4_K_q8_K

* Update ggml/src/ggml-cpu/ggml-cpu-quants.c

change to use K_SCALE_SIZE

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2025-01-16 11:11:49 +02:00

..

ggml-blas

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cann

llama : add Qwen2VL support + multimodal RoPE (#10361)

2024-12-14 14:43:46 +02:00

ggml-cpu

ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227)

2025-01-16 11:11:49 +02:00

ggml-cuda

RoPE: fix back, CUDA support for back + noncont. (#11240)

2025-01-15 12:51:37 +01:00

ggml-hip

ggml : do not define GGML_USE_CUDA when building with GGML_BACKEND_DL (#11211)

2025-01-13 13:31:41 +02:00

ggml-kompute

llama : add Qwen2VL support + multimodal RoPE (#10361)

2024-12-14 14:43:46 +02:00

ggml-metal

ggml : do not install metal source when embed library (ggml/1054)

2025-01-04 16:09:53 +02:00

ggml-musa

mtgpu: Add MUSA_DOCKER_ARCH in Dockerfiles && update cmake and make (#10516)

2024-11-26 17:00:41 +01:00

ggml-opencl

common, examples, ggml : fix MSYS2 GCC compiler errors and warnings when building with LLAMA_CURL=ON and GGML_OPENCL=ON (#11013)

2024-12-31 01:46:06 +01:00

ggml-rpc

rpc : code cleanup (#11107)

2025-01-07 08:37:02 +02:00

ggml-sycl

SYCL: Add gated linear attention kernel (#11175)

2025-01-15 11:20:17 +08:00

ggml-vulkan

vulkan: scale caching for k quants + misc fixes (#11081)

2025-01-15 19:50:13 +00:00

CMakeLists.txt

GGUF: C++ refactor, backend support, misc fixes (#11030)

2025-01-07 18:01:58 +01:00

ggml-alloc.c

ggml : remove return from ggml_gallocr_allocate_node (ggml/1048)

2024-12-17 18:35:49 +02:00

ggml-backend-impl.h

ggml : automatic selection of best CPU backend (#10606)

2024-12-01 16:12:41 +01:00

ggml-backend-reg.cpp

ggml : allow loading backend with env variable (ggml/1059)

2025-01-08 13:40:18 +02:00

ggml-backend.cpp

ggml-backend : only offload from host buffers (fix) (#11124)

2025-01-07 16:11:57 +01:00

ggml-common.h

CUDA: rename macros to avoid conflicts with WinAPI (#10736)

2024-12-10 18:23:24 +01:00

ggml-impl.h

GGUF: C++ refactor, backend support, misc fixes (#11030)

2025-01-07 18:01:58 +01:00

ggml-opt.cpp

ggml-opt: fix data corruption (ggml/1022)

2024-11-21 09:22:02 +02:00

ggml-quants.c

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00

ggml-quants.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

RoPE: fix back, CUDA support for back + noncont. (#11240)

2025-01-15 12:51:37 +01:00

gguf.cpp

GGUF: C++ refactor, backend support, misc fixes (#11030)

2025-01-07 18:01:58 +01:00