Logo
Explore Help
Register Sign In
EngineX-Ascend/enginex-ascend-910-llama.cpp
Watch 11
Star 0 Fork 0
Code Issues Pull Requests Actions 32 Projects Releases Wiki Activity
Files
97bdd26eee11fe109dec00de75690ceef61c03f2
enginex-ascend-910-llama.cpp/examples/lookup
T
History
Clint Herron 07a3fc0608 Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)
2024-07-02 12:18:10 -04:00
..
CMakeLists.txt
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
lookup-create.cpp
common : refactor cli arg parsing (#7675)
2024-06-04 21:23:39 +03:00
lookup-merge.cpp
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
lookup-stats.cpp
common : refactor cli arg parsing (#7675)
2024-06-04 21:23:39 +03:00
lookup.cpp
common : refactor cli arg parsing (#7675)
2024-06-04 21:23:39 +03:00
README.md
Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)
2024-07-02 12:18:10 -04:00

README.md

llama.cpp/examples/lookup

Demonstration of Prompt Lookup Decoding

https://github.com/apoorvumang/prompt-lookup-decoding

The key parameters for lookup decoding are ngram_min, ngram_max and n_draft. The first two determine the size of the ngrams to search for in the prompt for a match. The latter specifies how many subsequent tokens to draft if a match is found.

More info:

https://github.com/ggerganov/llama.cpp/pull/4484 https://github.com/ggerganov/llama.cpp/issues/4226

Reference in new issue View Git Blame Copy Permalink
Powered by Gitea Version: 28.4.0 Page: 35ms Template: 1ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API