enginex-ascend-910-llama.cpp/steps at 76e868821a94072fbc87cb1fcca291694319eae8 - enginex-ascend-910-llama.cpp - Gitea: Git with a cup of tea

EngineX-Ascend/enginex-ascend-910-llama.cpp

Files

History

Pierrick Hymbert 76e868821a server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937 )

Closes #5850

2024-03-08 12:25:04 +01:00

..

steps.py

server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937 )

2024-03-08 12:25:04 +01:00