初始化项目,由ModelHub XC社区提供模型

Model: tiiuae/Falcon-H1-1.5B-Instruct-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-18 14:31:06 +08:00
commit 7e2ee076a1
38 changed files with 351 additions and 0 deletions

82
.gitattributes vendored Normal file
View File

@@ -0,0 +1,82 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-BF16.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-F16.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-F32.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-TQ1_0.gguf filter=lfs diff=lfs merge=lfs -text
Falcon-H1-1.5B-Instruct-TQ2_0.gguf filter=lfs diff=lfs merge=lfs -text

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1fbddeab0ac843793f3e59b17bc3f95b63d88123c78c27c7c017a8520e68d24a
size 3113607616

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67b60737a47c845e8e99244f912ba7c5bc29ddee56dd61f81d938f69232f2d4c
size 3113607616

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c363f79a34ce0d468a246b6737313e05bbec0972a9e5836507b355577064dc61
size 6222119552

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d919934b7d2ada40e88ccdd37fa0140d0d229316d2d850c0ac466254d20d364
size 432073440

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfbd50e0ef434784a4c82e4c09ca0272037b199059270f44e59593b017e2ed7c
size 404075232

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5bcbd09a243506079b93892c1403101c445cf1d6d5f7adef1bf7fc070c0cba50
size 578556864

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3e1f13dd661cb10fb2b6ca21232e766acf32b9224b485052736f40accdf69d4
size 541225920

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dde1b16c6b81e4a5fb30f6a10ab640c1d9c33317234243fc6d1f893316c1848e
size 517640928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b0818a186ad9be2e8bddde293157415148f40db70a1d57f2e87049a75edf02b
size 478737120

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ea4c319f037c3592326dd9f95daa22254aaa7cc410b61e287b44a8bb2c3c065
size 737486048

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0e4f223f53c9e5941254c579df9379287984fcc1354e10f3a50eec7d59a0fd6
size 727041248

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc61ee816f30ac88fd09652c7bf63e8924b950a7071bcb05d157f8d0f5a71f37
size 708166880

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17893a6be1ae6adf0b1a3655be189ed6913e33f2d775f694bc6fa105b989fcea
size 647959488

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30981091cc505d9fd09651a50b7f352062df8744be2edb386cd62666918a6687
size 915541472

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02a0a4b73db1fd891fd8ec0ee48ff5dc310a7ec2272d3ecb50389c927500be02
size 871558560

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:544dfc683ead2742628b2d8e8d17cde929a9ece59c3f7ca12aa584aab5ff59cc
size 612211712

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:823957e89401681b154f6c3030beb57f78ecccbff4907fa0d9e7dff00d41ce60
size 590732288

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6371b4eb72d092a2e705d37e8dc1192c0ebbc2fac6633a8119efb9a0b06101d8
size 765117664

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3abb2c4583895cae37bd27aebe4341e71aca32f4a72a351669a5c63b433fbb4f
size 799982816

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6371b4eb72d092a2e705d37e8dc1192c0ebbc2fac6633a8119efb9a0b06101d8
size 765117664

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35b17d062b33ff2ed6af1ed15a599730960ae85884d5cb908dd1b434ff3caede
size 725370080

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80410ebb2375f754d087729cb531af5a54230b3fcbb94a0b24a3350536f86ee9
size 913968352

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a8d7cbd61c86cc302cbbb86d9d0a5f90736bf54ba7413c254b410df8e96cb2d
size 1002720608

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b51aa2aa34a0373fd0cd64c02eb91d1bc1da681c09e955ad769d4a9b2d8385f
size 944786656

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b51aa2aa34a0373fd0cd64c02eb91d1bc1da681c09e955ad769d4a9b2d8385f
size 944786656

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3800938998d94bc1fc1acc068e4386763464b9493ba34e00e4b7bf7cb1c6e0f1
size 917769440

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bc394128b147c31063e39b8edda918ac417e9352eb1add1bd3c545d52ccba45
size 1091472864

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0a746505b5af29644a09373263691981995c52c073bc7753730d83df271ae33
size 1180225120

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2222c01c7fe930a1ab7c7b47049afe8eb64bc14e6db2dea2e9918159b632f55
size 1107348960

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2222c01c7fe930a1ab7c7b47049afe8eb64bc14e6db2dea2e9918159b632f55
size 1107348960

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13789a041dfc9b0bb8c3c02d0fda9a3394fc88eaab97568cbc5a8cb599d5b412
size 1091472864

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55b153d7e529b79a247f4563abbae5909e2a556741810bc4967f668a1af5c90f
size 1280071424

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0044322ad5aaea5ccc2264f83f430f4ab2d20acc6db71a12d79b3f5acb0f69d5
size 1656492736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbe9d963f963832de4c93e847101e860cfd86b8a1db2a73473af49131d7bba09
size 461923808

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da7ee42b4a49068e428753516a6bdbd100d55192e081e7b7ee643613c5ca0aa4
size 522196448

163
README.md Normal file
View File

@@ -0,0 +1,163 @@
---
base_model: tiiuae/Falcon-H1-1.5B-Instruct
language:
- ar
- cs
- de
- en
- es
- fr
- hi
- it
- ja
- ko
- nl
- pl
- pt
- ro
- ru
- sv
- ur
- zh
library_name: transformers
license: other
license_name: falcon-llm-license
license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
tags:
- falcon-h1
inference: true
pipeline_tag: text-generation
---
<img src="https://huggingface.co/datasets/tiiuae/documentation-images/resolve/main/falcon_mamba/falcon-h1-logo.png" alt="drawing" width="800"/>
# Table of Contents
0. [TL;DR](#TL;DR)
1. [Model Details](#model-details)
2. [Training Details](#training-details)
3. [Usage](#usage)
4. [Evaluation](#evaluation)
5. [Citation](#citation)
# TL;DR
# Model Details
## Model Description
- **Developed by:** [https://www.tii.ae](https://www.tii.ae)
- **Model type:** Causal decoder-only
- **Architecture:** Hybrid Transformers + Mamba architecture
- **Language(s) (NLP):** English, Multilingual
- **License:** Falcon-LLM License
# Training details
For more details about the training protocol of this model, please refer to the [Falcon-H1 technical blogpost](https://falcon-lm.github.io/blog/falcon-h1/) and [Technical Report](https://arxiv.org/abs/2507.22448).
# Usage
Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or our custom fork of `llama.cpp` library.
## Inference
Make sure to install the latest version of `transformers` or `vllm`, eventually install these packages from source:
```bash
pip install git+https://github.com/huggingface/transformers.git
```
Refer to [the official vLLM documentation for more details on building vLLM from source](https://docs.vllm.ai/en/latest/getting_started/installation/gpu.html#build-wheel-from-source).
### 🤗 transformers
Refer to the snippet below to run H1 models using 🤗 transformers:
```python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "tiiuae/Falcon-H1-1B-Base"
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto"
)
# Perform text generation
```
### vLLM
For vLLM, simply start a server by executing the command below:
```
# pip install vllm
vllm serve tiiuae/Falcon-H1-1B-Instruct --tensor-parallel-size 2 --data-parallel-size 1
```
### 🦙 llama.cpp
Our architecture is integrated into the latest versions of `llama.cpp`: https://github.com/ggml-org/llama.cpp - you can use the our official GGUF files directly with llama.cpp
# Evaluation
Falcon-H1 series perform very well on a variety of tasks, including reasoning tasks.
| Tasks | Falcon-H1-1.5B | Qwen3-1.7B | Qwen2.5-1.5B | Gemma3-1B | Llama3.2-1B | Falcon3-1B |
| --- | --- | --- | --- | --- | --- | --- |
| **General** | | | | | |
| BBH | **46.47** | 35.18 | 42.41 | 35.86 | 33.21 | 34.47 |
| ARC-C | 42.06 | 34.81 | 40.53 | 34.13 | 34.64 | **43.09** |
| TruthfulQA | 45.98 | **49.39** | 47.05 | 42.17 | 42.08 | 42.31 |
| HellaSwag | **63.33** | 49.27 | 62.23 | 42.24 | 55.3 | 58.53 |
| MMLU | **62.03** | 57.04 | 59.76 | 40.87 | 45.93 | 46.1 |
| **Math** | | | | | |
| GSM8k | **74.98** | 69.83 | 57.47 | 42.38 | 44.28 | 44.05 |
| MATH-500 | **74.0** | 73.0 | 48.4 | 45.4 | 13.2 | 19.8 |
| AMC-23 | 43.59 | **46.09** | 24.06 | 19.22 | 7.19 | 6.87 |
| AIME-24 | 11.25 | **12.5** | 2.29 | 0.42 | 1.46 | 0.41 |
| AIME-25 | **9.58** | 8.12 | 1.25 | 1.25 | 0.0 | 0.21 |
| **Science** | | | | | |
| GPQA | 26.34 | 27.68 | 26.26 | **28.19** | 26.59 | 26.76 |
| GPQA_Diamond | **35.19** | 33.33 | 25.59 | 21.55 | 25.08 | 31.31 |
| MMLU-Pro | **37.8** | 23.54 | 28.35 | 14.46 | 16.2 | 18.49 |
| MMLU-stem | **64.13** | 54.3 | 54.04 | 35.39 | 39.16 | 39.64 |
| **Code** | | | | | |
| HumanEval | **68.29** | 67.68 | 56.1 | 40.85 | 34.15 | 22.56 |
| HumanEval+ | **61.59** | 60.96 | 50.61 | 37.2 | 29.88 | 20.73 |
| MBPP | **64.81** | 58.73 | **64.81** | 57.67 | 33.6 | 20.63 |
| MBPP+ | **56.35** | 49.74 | 56.08 | 50.0 | 29.37 | 17.2 |
| LiveCodeBench | **17.61** | 14.87 | 12.52 | 5.09 | 2.35 | 0.78 |
| CRUXEval | **39.57** | 18.88 | 34.76 | 12.7 | 0.06 | 15.58 |
| **Instruction Following** | | | | | |
| IFEval | **80.66** | 70.77 | 45.33 | 61.48 | 55.34 | 54.26 |
| Alpaca-Eval | **28.18** | 21.89 | 9.54 | 17.87 | 9.38 | 6.98 |
| MTBench | **8.46** | 7.61 | 7.1 | 7.03 | 6.37 | 6.03 |
| LiveBench | 34.13 | **40.73** | 21.65 | 18.79 | 14.97 | 14.1 |
You can check more in detail on our [our release blogpost](https://falcon-lm.github.io/blog/falcon-h1/), detailed benchmarks.
# Useful links
- View [our release blogpost](https://falcon-lm.github.io/blog/falcon-h1/).
- View [our technical report](https://arxiv.org/abs/2507.22448).
- View our [GitHub repository](https://github.com/tiiuae/Falcon-H1).
- View our [official documentation](https://tiiuae.github.io/Falcon-H1/).
- Feel free to join [our discord server](https://discord.gg/trwMYP9PYm) if you have any questions or to interact with our researchers and developers.
# Citation
If the Falcon-H1 family of models were helpful to your work, feel free to give us a cite.
```
@article{falconh1,
title={Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance},
author={Jingwei Zuo and Maksim Velikanov and Ilyas Chahed and Younes Belkada and Dhia Eddine Rhayem and Guillaume Kunsch and Hakim Hacid and Hamza Yous and Brahim Farhat and Ibrahim Khadraoui and Mugariya Farooq and Giulia Campesan and Ruxandra Cojocaru and Yasser Djilali and Shi Hu and Iheb Chaabane and Puneesh Khanna and Mohamed El Amine Seddik and Ngoc Dung Huynh and Phuc Le Khac and Leen AlQadi and Billel Mokeddem and Mohamed Chami and Abdalgader Abubaker and Mikhail Lubinets and Kacper Piskorski and Slim Frikha},
journal = {arXiv preprint arXiv:2507.22448},
year={2025}
}
```

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "others", "allow_remote": true}