22 lines
417 B
Markdown
22 lines
417 B
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
tags:
|
||
|
|
- merge
|
||
|
|
---
|
||
|
|
merge from quantum-v0.01 and mistral-7b-dpo-v5
|
||
|
|
|
||
|
|
The yaml config file for this model is here:
|
||
|
|
```yaml
|
||
|
|
slices:
|
||
|
|
- sources:
|
||
|
|
- model: quantumaikr/quantum-v0.01
|
||
|
|
layer_range: [0, 32]
|
||
|
|
- sources:
|
||
|
|
- model: mncai/mistral-7b-dpo-v5
|
||
|
|
layer_range: [24, 32]
|
||
|
|
merge_method: passthrough
|
||
|
|
dtype: bfloat16
|
||
|
|
```
|
||
|
|
|
||
|
|
# Acknowlegement
|
||
|
|
[mergekit](https://github.com/cg123/mergekit)
|