examples : add passkey test (#3856)

* examples : add passkey test * passkey : better prints * passkey : select pass key pos from CLI * passkey : simplify n_past logic * make : add passkey target * passkey : add "self-extend"-like context extension (#4810) * llama : "self-extend"-like context extension * passkey : add comment * passkey : add readme
2024-01-08 11:14:04 +02:00
parent b7e7982953
commit b0034d93ce
9 changed files with 361 additions and 1 deletions
--- a/llama.h
+++ b/llama.h
@@ -484,6 +484,13 @@ extern "C" {
                       llama_pos   p1,
                       llama_pos   delta);

+    LLAMA_API void llama_kv_cache_seq_div(
+            struct llama_context * ctx,
+                    llama_seq_id   seq_id,
+                       llama_pos   p0,
+                       llama_pos   p1,
+                             int   d);
+
    //
    // State / sessions
    //