LGAI-EXAONE/EXAONE-3.5-32B-Instruct-AWQ
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
LG-AI-EXAONE
2024-12-11 16:06:50 +09:00
parent 954db6f7b3
commit 2d17ab13e6
1 changed files with 1 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
README.md
View File

@@ -38,12 +38,7 @@ This repository contains the AWQ-quantized weights of the instruction-tuned 32B
## Quickstart
We recommend to use `transformers` v4.43 or later.
You also need to install the latest version of `AutoAWQ` library, which can be installed by the following command:
```bash
pip install git+https://github.com/casper-hansen/AutoAWQ.git
```
We recommend to use `transformers>=4.43` and `autoawq>=0.2.7.post3`.
Here is the code snippet to run conversational inference with the model: