EngineX-Ascend/enginex-ascend-910-llama.cpp
10
0
Fork 0
Code Issues Pull Requests Actions 4 Projects Releases Wiki Activity

scripts: benchmark for HTTP server throughput (#14668)

Browse Source 
* scripts: benchmark for HTTP server throughput

* fix server connection reset
This commit is contained in:
Johannes Gäßler
2025-07-14 13:14:30 +02:00
committed by GitHub
parent 0f4c6ec0f1
commit 494c5899cb
4 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
requirements/requirements-server-bench.txt Normal file
View File

@@ -0,0 +1,5 @@
datasets~=3.2.0
matplotlib~=3.10.0
numpy~=1.26.4
requests~=2.32.3
tqdm~=4.67.1