Jerry Zhang a7c47e0f02 Add torchao quant (int4/int8/fp8) to llama models (#1341) ...

Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

2024-09-09 05:32:41 -07:00

..

sglang

Add torchao quant (int4/int8/fp8) to llama models (#1341)

2024-09-09 05:32:41 -07:00

pyproject.toml

Add torchao quant (int4/int8/fp8) to llama models (#1341)

2024-09-09 05:32:41 -07:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00