Pierrick Hymbert fd72d2d2a5 server: tests: add truncated prompt tests, better kv cache size (#5933) ...

* server: tests: add truncated prompt tests, better size

* server, tests : update regex

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-03-09 11:30:04 +02:00

..

steps.py

server: tests: add truncated prompt tests, better kv cache size (#5933)

2024-03-09 11:30:04 +02:00