初始化项目,由ModelHub XC社区提供模型

Model: thrnn/qwen2.5-1.5b-medical-sft-dare
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-11 06:50:05 +08:00
commit 0d53d25647
8 changed files with 455028 additions and 0 deletions

41
README.md Normal file
View File

@@ -0,0 +1,41 @@
---
base_model:
- Qwen/Qwen2.5-1.5B-Instruct
library_name: transformers
tags:
- mergekit
- merge
---
# dare_p0.5
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [Linear DARE](https://arxiv.org/abs/2311.03099) merge method using [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) as a base.
### Models Merged
The following models were included in the merge:
* outputs/model_sft_lora
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: Qwen/Qwen2.5-1.5B-Instruct
parameters:
density: 1.0
weight: 1.0
- model: outputs/model_sft_lora
parameters:
density: 0.50
weight: 1.0
merge_method: dare_linear
base_model: Qwen/Qwen2.5-1.5B-Instruct
dtype: bfloat16
```