license, language, base_model, pipeline_tag, tags
| license | language | base_model | pipeline_tag | tags | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| apache-2.0 |
|
|
text-generation |
|
We have used the Karcher merging method to average five of the most representative Qwen2.5 14B derivative models, in commemoration of the efforts made by the open-source community for the Qwen2.5 14B model.
Merge Method
This model was merged using the Karcher Mean merge method.
Models Merged
The following models were included in the merge:
- Qwen/Qwen2.5-14B-Instruct
- Qwen/Qwen2.5-14B-Instruct-1M
- arcee-ai/Virtuoso-Small-v2
- deepcogito/cogito-v1-preview-qwen-14B
- deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
Configuration:
The following YAML configuration was used to produce this model:
models:
- model: Qwen/Qwen2.5-14B-Instruct
- model: Qwen/Qwen2.5-14B-Instruct-1M
- model: arcee-ai/Virtuoso-Small-v2
- model: deepcogito/cogito-v1-preview-qwen-14B
- model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
merge_method: karcher
parameters:
max_iter: 1000
dtype: bfloat16
tokenizer_source: base