enginex-ascend-910-llama.cpp/speculative at 0a5eebb45d5697127b84418576dc479c400c4b3d - enginex-ascend-910-llama.cpp - Gitea: Git with a cup of tea

EngineX-Ascend/enginex-ascend-910-llama.cpp

Files

History

FK 84e723653c speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00