Commit Graph

14 Commits

Author SHA1 Message Date
Lianmin Zheng
873d0e8537 Ignore detokenization error 2024-01-30 14:52:06 +00:00
Keith Stevens
1d0fbe8e43 [Feature] Adds basic support for image content in OpenAI chat routes (#113) 2024-01-30 06:12:33 -08:00
Lianmin Zheng
0617528632 Update quick start examples (#120) 2024-01-30 04:29:32 -08:00
Liangsheng Yin
81561f8e2d Flush Cache API (#103) 2024-01-25 21:32:59 -08:00
Lianmin Zheng
c70b3cfa9e Bump the version to v0.1.8 (#93) 2024-01-24 03:33:34 -08:00
Lianmin Zheng
bef0b35902 Fix llava & Fix multiprocessing 2024-01-24 10:35:31 +00:00
shiyi.c_98
c6576e820c Llava-hd Support (#92)
Co-authored-by: Haotian Liu <liuhaotian.cn@gmail.com>
2024-01-24 01:51:21 -08:00
Lianmin Zheng
99258181c6 set start method to spawn 2024-01-24 08:55:38 +00:00
isaac-vidas
3de54a1b55 Add health endpoint to SGLang runtime server (#90) 2024-01-23 19:00:28 -08:00
Ying Sheng
3f5c2f4c4a Add an async example (#37) 2024-01-21 15:17:30 -08:00
Lianmin Zheng
199e82a15d Format code & Improve readme (#52) 2024-01-18 23:51:19 -08:00
Cody Yu
23471f9aa3 Support v1/chat/completions (#50) 2024-01-18 23:43:09 -08:00
Cody Yu
61d4c93962 Support stream=True in v1/completions (#49) 2024-01-18 17:00:56 -08:00
Lianmin Zheng
22085081bb release initial code
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
2024-01-08 04:37:50 +00:00