Update quantization section
This commit is contained in:
@@ -236,7 +236,7 @@ Please refer to our [EXAONE Deep GitHub](https://github.com/LG-AI-EXAONE/EXAONE-
|
|||||||
|
|
||||||
## Quantization
|
## Quantization
|
||||||
|
|
||||||
We are working on quantized versions of EXAONE Deep models in both **AWQ** and **GGUF** formats. We will update this section with detailed instructions upon release.
|
We provide the pre-quantized EXAONE 3.5 models with **AWQ** and several quantization types in **GGUF** format. Please refer to our [EXAONE Deep collection](https://huggingface.co/collections/LGAI-EXAONE/exaone-deep-67d119918816ec6efa79a4aa) to find corresponding quantized models.
|
||||||
|
|
||||||
## Usage Guideline
|
## Usage Guideline
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user