25 lines
588 B
Markdown
25 lines
588 B
Markdown
---
|
|
language:
|
|
- ko
|
|
library_name: transformers
|
|
pipeline_tag: text-generation
|
|
---
|
|
|
|
**Model Developers** HyunseokLee, TaeyoungKim - (kaist alinlab, omnious.ai)
|
|
|
|
**Input** Models input text only.
|
|
|
|
**Output** Models generate text only.
|
|
|
|
**Model Architecture**
|
|
ko-en-llama2-13b is an auto-regressive language model based on the LLaMA2 transformer architecture.
|
|
|
|
**Base Model**
|
|
Llama-2-13B
|
|
|
|
**Training Dataset**
|
|
Open dataset wiki and AIhub (English + Korean).
|
|
|
|
**Training Objective**
|
|
We trained the model to learn Korean corpus while maintaining Llama's English ability.
|
|
(still training) |