yhyang201 dea2b84bc3 [OAI Server Refactor] [ChatCompletions & Completions] Implement UsageInfo Processor (#7360) ...

Co-authored-by: Chang Su <chang.s.su@oracle.com>

2025-06-20 14:51:21 -07:00

..

openai

[OAI Server Refactor] [ChatCompletions & Completions] Implement UsageInfo Processor (#7360)

2025-06-20 14:51:21 -07:00

engine.py

Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099)

2025-06-19 00:56:37 -07:00

EngineBase.py

feat: add direct routing strategy to DP worker (#6884)

2025-06-09 11:44:05 -07:00

http_server_engine.py

Purge VerlEngine (#7326)

2025-06-19 23:47:21 -07:00

http_server.py

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00