11 lines
274 B
Markdown
11 lines
274 B
Markdown
|
---
|
||
|
|
library_name: transformers
|
||
|
|
tags: []
|
||
|
|
---
|
||
|
|
|
||
|
|
# Model Card for dolphin-2.9.1-llama-3-70b-<u>awq</u>
|
||
|
|
|
||
|
|
|
||
|
|
AWQ Quantized version of [cognitivecomputations/dolphin-2.9.1-llama-3-70b](/cognitivecomputations/dolphin-2.9.1-llama-3-70b).
|
||
|
|
|
||
|
|
For use with vllm and other inference engines.
|