Ke Bao 2c615d120f [Feature] Support fp8 e5m2 kv cache with flashinfer (#1204) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>

2024-08-25 17:38:11 -07:00

..

sglang

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00

pyproject.toml

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00