scripts: benchmark for HTTP server throughput (#14668)

* scripts: benchmark for HTTP server throughput * fix server connection reset
2025-07-14 13:14:30 +02:00
parent 0f4c6ec0f1
commit 494c5899cb
4 changed files with 218 additions and 0 deletions
--- a/requirements/requirements-all.txt
+++ b/requirements/requirements-all.txt
@@ -3,6 +3,7 @@
 -r ../tools/server/tests/requirements.txt

 -r ./requirements-compare-llama-bench.txt
+-r ./requirements-server-bench.txt
 -r ./requirements-pydantic.txt
 -r ./requirements-test-tokenizer-random.txt