HAIDER-Math-32B-v1/README.md

base_model, library_name, tags

base_model	library_name	tags
	transformers	mergekit merge

haider-math-32b-lam05

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Task Arithmetic merge method using /home/azureuser/haider_project/models/qwen-32b as a base.

Models Merged

The following models were included in the merge:

• /home/azureuser/haider_project/models/qwq-32b
• /home/azureuser/haider_project/models/deepseek-r1-32b

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /home/azureuser/haider_project/models/qwq-32b
  - model: /home/azureuser/haider_project/models/deepseek-r1-32b

base_model: /home/azureuser/haider_project/models/qwen-32b

merge_method: task_arithmetic
parameters:
  weight: 0.5
  normalize: true

dtype: bfloat16