9 lines
535 B
Markdown
9 lines
535 B
Markdown
|
---
|
|||
|
|
license: apache-2.0
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
At Adept, we’re working towards an AI agent that can help people do anything they need to do on a computer. We’re not in the business of shipping isolated language models (LMs)—this was an early output of the model scaling program that will support our products.
|
|||
|
|
|
|||
|
|
We trained it from scratch using a context size of 16K. Many LM use cases are context-bound; our model has 4 times the context size of LLaMA2 and 8 times that of GPT-3, MPT, etc.
|
|||
|
|
|
|||
|
|
See https://www.adept.ai/blog/persimmon-8b for more info
|