4 Commits

Author	SHA1	Message	Date
Ying Sheng	712216928f	[Feature] Initial support for multi-LoRA serving (#1307)	2024-09-12 16:46:14 -07:00
Lianmin Zheng	f64eae3a29	[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)	2024-09-02 21:44:45 -07:00
Ying Sheng	0909bb0d2f	[Feat] Add window attention for gemma-2 (#1056)	2024-08-13 17:01:26 -07:00
Ying Sheng	4075677621	Add OpenAI backend to the CI test (#869)	2024-08-01 09:25:24 -07:00