初始化项目,由ModelHub XC社区提供模型

Model: YOYO-AI/Qwen2.5-3B-YOYO
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-02 23:13:14 +08:00
commit 05e895db14
14 changed files with 422 additions and 0 deletions

46
README.md Normal file
View File

@@ -0,0 +1,46 @@
---
base_model:
- Qwen/Qwen2.5-3B
- Qwen/Qwen2.5-3B-instruct
library_name: transformers
tags:
- mergekit
- merge
---
# merge
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [DELLA](https://arxiv.org/abs/2406.11617) merge method using [Qwen/Qwen2.5-3B](https://huggingface.co/Qwen/Qwen2.5-3B) as a base.
### Models Merged
The following models were included in the merge:
* [Qwen/Qwen2.5-3B-instruct](https://huggingface.co/Qwen/Qwen2.5-3B-instruct)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: Qwen/Qwen2.5-3B-instruct
parameters:
density: 1
weight: 1
lambda: 0.9
merge_method: della
base_model: Qwen/Qwen2.5-3B
parameters:
density: 1
weight: 1
lambda: 0.9
normalize: true
int8_mask: true
dtype: bfloat16
```