4 Commits

Author	SHA1	Message	Date
Lianmin Zheng	549e8b8366	[Minor] Fix a typo in test_torchao.py (#1976)	2024-11-09 15:07:27 -08:00
Lianmin Zheng	86fc0d79d0	Add a watch dog thread (#1816)	2024-10-27 02:00:50 -07:00
Lianmin Zheng	9ba1f09760	[Fix] Fix logprob and normalized_logprob (#1428)	2024-09-15 06:36:06 -07:00
Jerry Zhang	a7c47e0f02	Add torchao quant (int4/int8/fp8) to llama models (#1341) ... Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>	2024-09-09 05:32:41 -07:00