28 lines
731 B
Markdown
28 lines
731 B
Markdown
|
---
|
||
|
|
license: other
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
base_model:
|
||
|
|
- tiiuae/Falcon3-7B-Instruct
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
tags:
|
||
|
|
- falcon3
|
||
|
|
- falcon
|
||
|
|
- falcon-moe
|
||
|
|
- moe
|
||
|
|
- llama
|
||
|
|
---
|
||
|
|
|
||
|
|
# Falcon3 MoE 2x7B Instruct
|
||
|
|
|
||
|
|
Mixture of Experts of Falcon3 7B-IT & 7B-IT.
|
||
|
|
|
||
|
|
- 13.4B parameters
|
||
|
|
- BF16
|
||
|
|
- Falcon3 (Llama)
|
||
|
|
- Instruct
|
||
|
|
|
||
|
|
## Falcon3-7B-Instruct
|
||
|
|
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.
|
||
|
|
|
||
|
|
This repository contains the Falcon3-7B-Instruct. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.
|