37 lines
1.3 KiB
Markdown
37 lines
1.3 KiB
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
base_model:
|
||
|
|
- Qwen/Qwen2.5-1.5B
|
||
|
|
- Qwen/Qwen2.5-Math-1.5B-Instruct
|
||
|
|
- DeepSeek-AI/DeepSeek-R1-Distill-Qwen-1.5B
|
||
|
|
tags:
|
||
|
|
- merge
|
||
|
|
- mergekit
|
||
|
|
- dare-ties
|
||
|
|
- medical-reasoning
|
||
|
|
- clinical-coding
|
||
|
|
---
|
||
|
|
|
||
|
|
# DeepSeek-R1-Distill-Merge-Qwen-Math-1.5Bb
|
||
|
|
|
||
|
|
This model is a high-performance merge designed to bridge **Mathematical Logic** and **Reasoning**. It was constructed using **MergeKit** with the **DARE-TIES** method to preserve specialized weights from both source models.
|
||
|
|
|
||
|
|
## Merge Methodology
|
||
|
|
The merge integrates the logical foundations of **Qwen2.5-Math** with the distilled reasoning capabilities of **DeepSeek-R1**. This combination aims to improve accuracy in structured tasks such as **USMLE-style Q&A** and **ICD-10 clinical coding**.
|
||
|
|
|
||
|
|
- **Merge Method:** `dare_ties`
|
||
|
|
- **Base Model:** `Qwen/Qwen2.5-1.5B`
|
||
|
|
- **Models Integrated:**
|
||
|
|
- `Qwen/Qwen2.5-Math-1.5B-Instruct` (Weight: 0.5)
|
||
|
|
- `DeepSeek-AI/DeepSeek-R1-Distill-Qwen-1.5B` (Weight: 0.5)
|
||
|
|
- **Parameters:**
|
||
|
|
- Density: 0.53
|
||
|
|
- Normalize: True
|
||
|
|
- Int8 Mask: True
|
||
|
|
|
||
|
|
## Usage
|
||
|
|
This model is intended for research purposes in the medical domain. It excels at tasks requiring **Chain-of-Thought (CoT)** explanation before providing a final medical answer.
|
||
|
|
|
||
|
|
## Citation (Journal Submission)
|
||
|
|
If using this model for research, please cite the merge methodology and the source models accordingly.
|