23 lines
1.2 KiB
Markdown
23 lines
1.2 KiB
Markdown
---
|
|
license: llama2
|
|
---
|
|
|
|
# LLaMA-PRO-Instruct Model Card
|
|
|
|
## Model Description
|
|
LLaMA-PRO-Instruct is a transformative expansion of the LLaMA2-7B model, now boasting 8.3 billion parameters. It uniquely specializes in programming, coding, and mathematical reasoning, maintaining versatility in general language tasks.
|
|
|
|
## Development and Training
|
|
This model, developed by Tencent ARC team, extends LLaMA2-7B using innovative block expansion techniques. It's meticulously trained on a diverse blend of coding and mathematical data, encompassing over 80 billion tokens.
|
|
|
|
## Intended Use
|
|
LLaMA-PRO-Instruct is ideal for complex NLP challenges, excelling in programming, mathematical reasoning, and general language processing, suitable for both specialized and broad applications.
|
|
|
|
## Performance
|
|
It surpasses its predecessors in the LLaMA series, especially in code domains, demonstrating exceptional competence as a comprehensive language model.
|
|
|
|
## Limitations
|
|
Despite advancements, it may encounter difficulties in highly niche or nuanced tasks.
|
|
|
|
## Ethical Considerations
|
|
Users are advised to consider inherent biases and responsibly manage its application across various fields. |