Timofey c8f549d96d Fix parsing ChatCompletionMessage (#7273) ...

Co-authored-by: Timofey K <timosha1113@gmail.com>

2025-07-28 11:35:14 -07:00

..

openai

Fix parsing ChatCompletionMessage (#7273)

2025-07-28 11:35:14 -07:00

engine.py

chore: upgrade flashinfer v0.2.9rc2 (#8406)

2025-07-27 01:41:22 -07:00

EngineBase.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

http_server_engine.py

[Multimodal][Perf] Use pybase64 instead of base64 (#7724)

2025-07-08 14:00:58 -07:00

http_server.py

feat: throttle requests at scheduler based on --max_queued_requests (#7565)

2025-07-28 22:32:33 +08:00