Zhiyu c66b2c9cf1 Add support for nvidia modelopt fp8 kv cache (#3223)

2025-02-22 07:04:58 +08:00

..

sglang

Add support for nvidia modelopt fp8 kv cache (#3223)

2025-02-22 07:04:58 +08:00

pyproject.toml

use transformers 4.48.3 (#3650)

2025-02-18 04:40:47 +08:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00