EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
900 Commits 8 Branches 0 Tags
3f0fe08d3748dfd5aa70f4620bb44bdd6765e335
Commit Graph

2 Commits

Author SHA1 Message Date
Lianmin Zheng
9ba1f09760 [Fix] Fix logprob and normalized_logprob (#1428) 2024-09-15 06:36:06 -07:00
Jerry Zhang
a7c47e0f02 Add torchao quant (int4/int8/fp8) to llama models (#1341) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2024-09-09 05:32:41 -07:00