This website requires JavaScript.
Explore
Help
Register
Sign In
EngineX-Ascend
/
enginex-ascend-910-llama.cpp
Watch
10
Star
0
Fork
0
You've already forked enginex-ascend-910-llama.cpp
Code
Issues
Pull Requests
Actions
4
Projects
Releases
Wiki
Activity
Files
23b5e12eb5a76489b4c3ee22213a081da68b1809
enginex-ascend-910-llama.cpp
/
examples
/
speculative
History
Georgi Gerganov
1f5cd83275
examples : add readme files
2023-11-29 11:00:17 +02:00
..
CMakeLists.txt
build : link against build info instead of compiling against it (
#3879
)
2023-11-02 08:50:16 +02:00
README.md
examples : add readme files
2023-11-29 11:00:17 +02:00
speculative.cpp
speculative : fix prompt tokenization in speculative example (
#4025
)
2023-11-20 11:50:04 +02:00
README.md
llama.cpp/examples/speculative
Demonstartion of speculative decoding and tree-based speculative decoding techniques
More info:
https://github.com/ggerganov/llama.cpp/pull/2926
https://github.com/ggerganov/llama.cpp/pull/3624
