EngineX-Ascend/enginex-ascend-910-llama.cpp
10
0
Fork 0
Code Issues Pull Requests Actions 4 Projects Releases Wiki Activity
Files
d52d7819b8ced70c642a88a59da8c78208dc58ec
enginex-ascend-910-llama.cpp/examples/server/tests/features/steps
History
Pierrick Hymbert d52d7819b8 server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708) 
* server: monitoring - add /metrics prometheus compatible endpoint

* server: concurrency issue, when 2 task are waiting for results, only one call thread is notified

* server: metrics - move to a dedicated struct
2024-02-25 13:49:43 +01:00
..
steps.py
server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)
2024-02-25 13:49:43 +01:00