Meta-Llama-3-8B-Instruct-hf-AWQ/README.md

base_model, license, license_name, license_link, library_name, tags, pipeline_tag, inference, quantized_by

base_model	license	license_name	license_link	library_name	tags	pipeline_tag	inference	quantized_by
Undi95/Meta-Llama-3-8B-Instruct-hf	other	llama3	LICENSE	transformers	4-bit AWQ text-generation autotrain_compatible endpoints_compatible facebook meta pytorch llama llama-3	text-generation	false	Suparious

Undi95/Meta-Llama-3-8B-hf AWQ

• Original model: Meta-Llama-3-8B-instruct-hf

Model Summary

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, we took great care to optimize helpfulness and safety.

Model developers Meta

Variations Llama 3 comes in two sizes — 8B and 70B parameters — in pre-trained and instruction tuned variants.

Input Models input text only.

Output Models generate text and code only.

Model Architecture Llama 3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.

@article{llama3modelcard,
  title={Llama 3 Model Card},
  author={AI@Meta},
  year={2024},
  url = {https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md}
}