server : add lora hotswap endpoint (WIP) (#8857)

* server : add lora hotswap endpoint * handle lora_no_apply * fix build * updae docs * clean up struct def * fix build * add LoRA test * fix style
2024-08-06 17:33:39 +02:00
parent 641f5dd2a6
commit 1e6f6554aa
9 changed files with 251 additions and 92 deletions
--- a/examples/server/tests/requirements.txt
+++ b/examples/server/tests/requirements.txt
@@ -4,3 +4,4 @@ huggingface_hub~=0.20.3
 numpy~=1.26.4
 openai~=1.30.3
 prometheus-client~=0.20.0
+requests~=2.32.3