22 lines
417 B
Markdown
22 lines
417 B
Markdown
---
|
|
license: apache-2.0
|
|
tags:
|
|
- merge
|
|
---
|
|
merge from quantum-v0.01 and mistral-7b-dpo-v5
|
|
|
|
The yaml config file for this model is here:
|
|
```yaml
|
|
slices:
|
|
- sources:
|
|
- model: quantumaikr/quantum-v0.01
|
|
layer_range: [0, 32]
|
|
- sources:
|
|
- model: mncai/mistral-7b-dpo-v5
|
|
layer_range: [24, 32]
|
|
merge_method: passthrough
|
|
dtype: bfloat16
|
|
```
|
|
|
|
# Acknowlegement
|
|
[mergekit](https://github.com/cg123/mergekit) |