enginex-ascend-910-llama.cpp/speculative at 71ca2fad7d6c0ef95ef9944fb3a1a843e481f314 - enginex-ascend-910-llama.cpp - Gitea: Git with a cup of tea

EngineX-Ascend/enginex-ascend-910-llama.cpp

Files

History

FK 84e723653c speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00