Branden Butler 40a34fe8d0 speculative : fix prompt tokenization in speculative example (#4025) ...

* Support special tokens and not adding BOS to prompt in speculative

* Adapt to new should_add_bos function

* Ensure tgt and dft have same add_bos setting

2023-11-20 11:50:04 +02:00

..

CMakeLists.txt

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

speculative.cpp

speculative : fix prompt tokenization in speculative example (#4025)

2023-11-20 11:50:04 +02:00