HAI e0b5dbcec1 [FP8 KV Cache] Avoid KeyError at loading pre-quantized FP8 model with kv_scale (#1559)

2024-10-03 01:52:26 -07:00

..

sglang

[FP8 KV Cache] Avoid KeyError at loading pre-quantized FP8 model with kv_scale (#1559)

2024-10-03 01:52:26 -07:00

pyproject.toml

[bugfix] Add modelscope package to avoid docker image without modelscope (#1520)

2024-09-28 12:43:22 -07:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00