初始化项目,由ModelHub XC社区提供模型
Model: ehristoforu/Falcon3-MoE-2x7B-Insruct Source: Original Platform
This commit is contained in:
28
README.md
Normal file
28
README.md
Normal file
@@ -0,0 +1,28 @@
|
||||
---
|
||||
license: other
|
||||
language:
|
||||
- en
|
||||
base_model:
|
||||
- tiiuae/Falcon3-7B-Instruct
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- falcon3
|
||||
- falcon
|
||||
- falcon-moe
|
||||
- moe
|
||||
- llama
|
||||
---
|
||||
|
||||
# Falcon3 MoE 2x7B Instruct
|
||||
|
||||
Mixture of Experts of Falcon3 7B-IT & 7B-IT.
|
||||
|
||||
- 13.4B parameters
|
||||
- BF16
|
||||
- Falcon3 (Llama)
|
||||
- Instruct
|
||||
|
||||
## Falcon3-7B-Instruct
|
||||
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.
|
||||
|
||||
This repository contains the Falcon3-7B-Instruct. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.
|
||||
Reference in New Issue
Block a user