初始化项目,由ModelHub XC社区提供模型

Model: qikp/hummingbird-2.6-110m
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-10 21:50:40 +08:00
commit 7731df35be
9 changed files with 250485 additions and 0 deletions

38
README.md Normal file
View File

@@ -0,0 +1,38 @@
---
license: apache-2.0
datasets:
- qikp/sillychat
language:
- en
base_model:
- cerebras/Cerebras-GPT-111M
pipeline_tag: text-generation
library_name: transformers
new_version: qikp/hummingbird-2.7-110m
---
# Hummingbird
🎉 You are looking at Hummingbird 2.6, which uses different and slightly better datasets!
Hummingbird is a Cerebras-GPT derivative trained to be conversational.
## Training
The model was trained using 500 steps, and 4 batch size.
### Datasets
The training corpus is made up of a collated [qikp/sillychat](https://huggingface.co/datasets/qikp/sillychat) to be multi-turn.
### Chat template
The Zephyr chat template was used.
## Limitations
The model frequently outputs incorrect information, confirmation with a larger, mature model is advised.
## Benchmark
This model was benchmarked and compared using embeddings. See the results [here](https://codeberg.org/qikp/benchmarks).