ggml-org/llama.cpp
b7751
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info: