Georgi Gerganov e298d2fbd0 kv-cache : add SWA support (#13194) ...

* kv-cache : prepare for SWA

ggml-ci

* kv-cache : initial iSWA implementation

ggml-ci

* kv-cache : rework error recovery logic

ggml-ci

* models : fix Phi-3 SWA parameters

ggml-ci

* model : adjust Granite to rope factor changes

ggml-ci

* server : check if context can do shifts

ggml-ci

* iswa : for now, always enable shifts (experiment)

ggml-ci

* kv-cache : simplify SWA logic

ggml-ci

* kv-cache : apply defrag when we fail to find slots for the batch

ggml-ci

* llama : update docs about llama_decode

ggml-ci

* kv-cache : update warning logs when no space for the batch is available

ggml-ci

* llama : add llama_kv_self_seq_pos_min()

* kv-cache : keep track of partial SWA computes and print warnings

* server : disallow use cases involving partial SWA context

ggml-ci

* llama : add param to control SWA cache size

ggml-ci

* minor : clean-up

ggml-ci

2025-05-20 08:05:46 +03:00

..

cmake

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

minja

minja: sync (qwen3) (#13573)

2025-05-15 23:29:10 +01:00

arg.cpp

kv-cache : add SWA support (#13194)

2025-05-20 08:05:46 +03:00

arg.h

common : add common_remote_get_content (#13123)

2025-04-26 22:58:12 +02:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

chat.cpp

server: inject date_string in llama 3.x template + fix date for firefunction v2 (#12802)

2025-05-15 02:39:51 +01:00

chat.h

server: inject date_string in llama 3.x template + fix date for firefunction v2 (#12802)

2025-05-15 02:39:51 +01:00

CMakeLists.txt

llguidance : official v0.7.20 release (no actual changes) [noci] (#13594)

2025-05-16 22:56:28 +02:00

common.cpp

kv-cache : add SWA support (#13194)

2025-05-20 08:05:46 +03:00

common.h

kv-cache : add SWA support (#13194)

2025-05-20 08:05:46 +03:00

console.cpp

console : utf-8 fix for windows stdin (#9690)

2024-09-30 11:23:42 +03:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

json-schema-to-grammar.cpp

grammar : handle maxItems == 0 in JSON schema (#13117)

2025-04-26 10:10:20 +02:00

json-schema-to-grammar.h

tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)

2025-03-05 13:05:13 +00:00

json.hpp

json-schema-to-grammar improvements (+ added to server) (#5978)

2024-03-21 11:50:43 +00:00

llguidance.cpp

llguidance : set tokenizer slices to default (#13424)

2025-05-10 17:19:52 +02:00

log.cpp

Fix: Compile failure due to Microsoft STL breaking change (#11836)

2025-02-12 21:36:11 +01:00

log.h

cleanup: fix compile warnings associated with gnu_printf (#11811)

2025-02-12 10:06:53 -04:00

ngram-cache.cpp

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ngram-cache.h

llama : use LLAMA_TOKEN_NULL (#11062)

2025-01-06 10:52:15 +02:00

regex-partial.cpp

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

regex-partial.h

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

sampling.cpp

common : Add a warning when we can't match samplers from a string or char. (#13330)

2025-05-07 11:23:28 +03:00

sampling.h

sampling : support for llguidance grammars (#10224)

2025-02-02 09:55:32 +02:00

speculative.cpp

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

speculative.h

speculative : update default params (#11954)

2025-02-19 13:29:42 +02:00

stb_image.h

common : Update stb_image.h to latest version (#9161)

2024-08-27 08:58:50 +03:00