EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181)

Browse Source 
Signed-off-by: Mingshan <git@brighill.com>
This commit is contained in:
Mingshan
2025-03-08 17:03:38 +08:00
committed by GitHub
parent 08c4d764a5
commit 0fe7c13be1
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/bench_serving.py
View File

@@ -1006,7 +1006,7 @@ async def benchmark(
# Flush cache # Flush cache
if "sglang" in backend: if "sglang" in backend:
requests.post(base_url + "/flush_cache") requests.post(base_url + "/flush_cache", headers=get_auth_headers())
time.sleep(1.0) time.sleep(1.0)