Ruikai Peng dd6e6d0b6a vocab : prevent tokenizer overflow (#14301) ...

* vocab : prevent stack overflow in tokenize

* vocab : return error instead of aborting on oversized token count

* vocab : INT32_MIN from llama_tokenize on overflow

2025-06-20 07:13:06 -07:00

..

llama-cpp.h

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

llama.h

vocab : prevent tokenizer overflow (#14301)

2025-06-20 07:13:06 -07:00