Commit Graph

7 Commits

Author SHA1 Message Date
Liangsheng Yin
0877f1e75b Fix streaming (#600) 2024-07-07 01:55:58 -07:00
Ying Sheng
fb9296f0ed Higher priority for user input of max_prefill_tokens & format (#540) 2024-06-12 21:48:40 -07:00
Lianmin Zheng
8dbdc018a3 Abort disconnected requests (#457) 2024-05-20 18:41:21 -07:00
Lianmin Zheng
8210ec60f4 Improve error handling & abort disconnected requests (#449) 2024-05-17 05:49:31 -07:00
Matthias Gerstgrasser
d75dc20fae Add finish_reason to OpenAI API (#446) 2024-05-16 14:55:05 -07:00
Liangsheng Yin
690d162d97 Format code (#441) 2024-05-14 22:40:46 +08:00
Lianmin Zheng
3fc97f6709 Move openai api server into a separate file (#429) 2024-05-12 06:41:32 -07:00