Georgi Gerganov 921772104b speculative : add grammar support (#2991) ...

* speculative : add grammar support

* grammars : add json_arr.gbnf

* grammar : add comments to new grammar file

* grammar : remove one nested level

* common : warm-up with 2 tokens - seems to work better

* speculative : print draft token pieces

* speculative : reuse grammar parser + better logs and comments

* speculative : avoid grammar_mem

* make : fix speculative build

2023-09-05 08:46:17 +03:00

..

CMakeLists.txt

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

common.cpp

speculative : add grammar support (#2991)

2023-09-05 08:46:17 +03:00

common.h

build : on Mac OS enable Metal by default (#2901)

2023-09-04 22:26:24 +03:00

console.cpp

build : fix most gcc and clang warnings (#2861)

2023-09-01 16:34:50 +03:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

grammar-parser.cpp

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

grammar-parser.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

log.h

logging: Fix creating empty file even when disabled (#2966)

2023-09-02 11:53:55 -06:00