Update quantization section

This commit is contained in:
ai-modelscope
2025-03-19 07:45:43 +08:00
parent 5f3c6d6dd7
commit ce352a1910

View File

@@ -236,7 +236,7 @@ Please refer to our [EXAONE Deep GitHub](https://github.com/LG-AI-EXAONE/EXAONE-
## Quantization
We are working on quantized versions of EXAONE Deep models in both **AWQ** and **GGUF** formats. We will update this section with detailed instructions upon release.
We provide the pre-quantized EXAONE 3.5 models with **AWQ** and several quantization types in **GGUF** format. Please refer to our [EXAONE Deep collection](https://huggingface.co/collections/LGAI-EXAONE/exaone-deep-67d119918816ec6efa79a4aa) to find corresponding quantized models.
## Usage Guideline