harrisonlimh 747dd45077 feat: throttle requests at scheduler based on --max_queued_requests (#7565)

2025-07-28 22:32:33 +08:00

..

openai

feat: throttle requests at scheduler based on --max_queued_requests (#7565)

2025-07-28 22:32:33 +08:00

engine.py

chore: upgrade flashinfer v0.2.9rc2 (#8406)

2025-07-27 01:41:22 -07:00

EngineBase.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

http_server_engine.py

[Multimodal][Perf] Use pybase64 instead of base64 (#7724)

2025-07-08 14:00:58 -07:00

http_server.py

feat: throttle requests at scheduler based on --max_queued_requests (#7565)

2025-07-28 22:32:33 +08:00