Files
r1-distill-qwen7b-offline/README.md

8 lines
248 B
Markdown
Raw Normal View History

---
license: mit
---
# R1-Distill-Qwen-7B-AWQ — offline inference bundle
AWQ 4-bit reasoning model with a self-contained script.py that runs fully offline (loads from `.`). Reasons step by step, then emits a final JSON array. Fits a 16 GB GPU.