library_name, tags
| library_name | tags |
|---|---|
| transformers |
Model Card for dolphin-2.9.1-llama-3-70b-awq
AWQ Quantized version of cognitivecomputations/dolphin-2.9.1-llama-3-70b.
For use with vllm and other inference engines.
| library_name | tags |
|---|---|
| transformers |
AWQ Quantized version of cognitivecomputations/dolphin-2.9.1-llama-3-70b.
For use with vllm and other inference engines.