Files
WestLakeX-7B-EvoMerge/README.md

13 lines
680 B
Markdown
Raw Permalink Normal View History

---
base_model: []
license: apache-2.0
datasets:
- argilla/distilabel-intel-orca-dpo-pairs
---
# WestLakeX-7B-EvoMerge
This is the result of a small-scale [EvoMerge](https://github.com/BarryFutureman/EvoMerge).\
(Experiment Conclusion: Higher mutation strength does not seem to improve performance so far. Average eval score is below all candidates in initial population. Though this is a single experiment, it is not definitive that higher mutation strength is unnecessary. For example, it could be useful at a bigger scale.)
Zoom in to view the family tree:
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6599dc66eabe0f3e98de7cf6/C4DKIDjn71hf-dqBlg75O.png)