8 lines
220 B
Markdown
8 lines
220 B
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
---
|
||
|
|
|
||
|
|
# Qwen2.5-14B-Instruct-AWQ — offline inference bundle
|
||
|
|
|
||
|
|
AWQ 4-bit weights of Qwen2.5-14B-Instruct with a self-contained script.py that runs fully offline (loads from `.`). Fits a 16 GB GPU.
|