初始化项目,由ModelHub XC社区提供模型
Model: olusegunola/DeepSeek-R1-Distill-Merge-Qwen-Math-1.5Bb Source: Original Platform
This commit is contained in:
36
README.md
Normal file
36
README.md
Normal file
@@ -0,0 +1,36 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model:
|
||||
- Qwen/Qwen2.5-1.5B
|
||||
- Qwen/Qwen2.5-Math-1.5B-Instruct
|
||||
- DeepSeek-AI/DeepSeek-R1-Distill-Qwen-1.5B
|
||||
tags:
|
||||
- merge
|
||||
- mergekit
|
||||
- dare-ties
|
||||
- medical-reasoning
|
||||
- clinical-coding
|
||||
---
|
||||
|
||||
# DeepSeek-R1-Distill-Merge-Qwen-Math-1.5Bb
|
||||
|
||||
This model is a high-performance merge designed to bridge **Mathematical Logic** and **Reasoning**. It was constructed using **MergeKit** with the **DARE-TIES** method to preserve specialized weights from both source models.
|
||||
|
||||
## Merge Methodology
|
||||
The merge integrates the logical foundations of **Qwen2.5-Math** with the distilled reasoning capabilities of **DeepSeek-R1**. This combination aims to improve accuracy in structured tasks such as **USMLE-style Q&A** and **ICD-10 clinical coding**.
|
||||
|
||||
- **Merge Method:** `dare_ties`
|
||||
- **Base Model:** `Qwen/Qwen2.5-1.5B`
|
||||
- **Models Integrated:**
|
||||
- `Qwen/Qwen2.5-Math-1.5B-Instruct` (Weight: 0.5)
|
||||
- `DeepSeek-AI/DeepSeek-R1-Distill-Qwen-1.5B` (Weight: 0.5)
|
||||
- **Parameters:**
|
||||
- Density: 0.53
|
||||
- Normalize: True
|
||||
- Int8 Mask: True
|
||||
|
||||
## Usage
|
||||
This model is intended for research purposes in the medical domain. It excels at tasks requiring **Chain-of-Thought (CoT)** explanation before providing a final medical answer.
|
||||
|
||||
## Citation (Journal Submission)
|
||||
If using this model for research, please cite the merge methodology and the source models accordingly.
|
||||
Reference in New Issue
Block a user