55 lines
2.4 KiB
Markdown
55 lines
2.4 KiB
Markdown
---
|
|
license: apache-2.0
|
|
pipeline_tag: text-generation
|
|
---
|
|
|
|
**Typhoon2-Qwen2.5-7B**: Thai Large Language Model (Instruct)
|
|
|
|
**Typhoon2-Qwen2.5-7B** is a pretrained only Thai 🇹🇭 large language model with 7 billion parameters, and it is based on Qwen2.5-7B.
|
|
|
|
|
|
For technical-report. please see our [arxiv](https://arxiv.org/abs/2412.13702).
|
|
|
|
## **Performance**
|
|
|
|
| Model | ThaiExam | ONET | IC | A-Level | TGAT | TPAT | M3Exam | Math | Science | Social | Thai |
|
|
|------------------------|----------|--------|-----------|-----------|-----------|-----------|-----------|------------|------------|------------|------------|
|
|
| **Typhoon2 Qwen2.5 7B Base** | **58.86%** | **58.64%** | 65.26% | **55.11%** | 66.15% | 49.13% | **59.90%** | 42.98% | **59.42%** | **75.62%** | **61.59%** |
|
|
| **Qwen2.5 7B** | 55.74% | 51.23% | **60.00%** | 41.73% | **72.30%** | **53.44%** | 55.65% | **46.15%** | 54.10% | 66.54% | 55.82% |
|
|
| **Typhoon1.5 Llama3 8B Base** | 48.82% | 41.35% | 41.05% | 40.94% | 70.76% | 50.00% | 43.88% | 22.62% | 43.47% | 62.81% | 46.63% |
|
|
|
|
|
|
## **Model Description**
|
|
|
|
- **Model type**: A 7B decoder-only model based on Qwen2 architecture.
|
|
- **Requirement**: transformers 4.45.0 or newer.
|
|
- **Primary Language(s)**: Thai 🇹🇭 and English 🇬🇧
|
|
- **License**: Apache-2.0
|
|
|
|
|
|
## **Intended Uses & Limitations**
|
|
|
|
This model is a pretrained base model. Thus, it may not be able to follow human instructions without using one/few-shot learning or instruction fine-tuning. The model does not have any moderation mechanisms, and may generate harmful or inappropriate responses.
|
|
|
|
## **Follow us**
|
|
|
|
**https://twitter.com/opentyphoon**
|
|
|
|
## **Support**
|
|
|
|
**https://discord.gg/us5gAYmrxw**
|
|
|
|
## **Citation**
|
|
|
|
- If you find Typhoon2 useful for your work, please cite it using:
|
|
```
|
|
@misc{typhoon2,
|
|
title={Typhoon 2: A Family of Open Text and Multimodal Thai Large Language Models},
|
|
author={Kunat Pipatanakul and Potsawee Manakul and Natapong Nitarach and Warit Sirichotedumrong and Surapon Nonesung and Teetouch Jaknamon and Parinthapat Pengpun and Pittawat Taveekitworachai and Adisai Na-Thalang and Sittipong Sripaisarnmongkol and Krisanapong Jirayoot and Kasima Tharnpipitchai},
|
|
year={2024},
|
|
eprint={2412.13702},
|
|
archivePrefix={arXiv},
|
|
primaryClass={cs.CL},
|
|
url={https://arxiv.org/abs/2412.13702},
|
|
}
|
|
``` |