EngineX-Ascend/enginex-ascend-910-llama.cpp
10
0
Fork 0
Code Issues Pull Requests Actions 4 Projects Releases Wiki Activity
995 Commits 1 Branch 1 Tag
a73ccf1aa34de49f61bfeb7f8a679c3bfdb3abe3
Commit Graph

1 Commits

Author SHA1 Message Date
jwj7140
f257fd2550 Add an API example using server.cpp similar to OAI. (#2009) 
* add api_like_OAI.py
* add evaluated token count to server
* add /v1/ endpoints binding
 2023-07-04 21:06:12 +03:00