EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
808 Commits 8 Branches 0 Tags
8c0efa514dd17c49de2cf334a3cb49ec40fa3f3a
Commit Graph

1 Commits

Author SHA1 Message Date
Jerry Zhang
a7c47e0f02 Add torchao quant (int4/int8/fp8) to llama models (#1341) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2024-09-09 05:32:41 -07:00