ryang bc24205b32 Support BNB quantization for llama/mllama (#5038) ...

Co-authored-by: Yuhao Yang <yyh073@foxmail.com>

2025-04-15 18:00:31 -07:00

..

__init__.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

loader.py

Support BNB quantization for llama/mllama (#5038)

2025-04-15 18:00:31 -07:00

utils.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

weight_utils.py

Support Llama4 fp8 inference (#5194)

2025-04-09 20:14:34 +08:00