40 lines
1.3 KiB
Markdown
40 lines
1.3 KiB
Markdown
---
|
|
library_name: transformers
|
|
license: mit
|
|
---
|
|
|
|
# LLM Model Merging
|
|
|
|
## YouTube Tutorial
|
|
<div align="center">
|
|
<a href="https://youtu.be/gNXBp3wttFU">Model Merging: Merge LLMs to Create Frankestein Models - Python, HuggingFace, Mergekit</a>
|
|
<br>
|
|
<br>
|
|
<a href="https://youtu.be/gNXBp3wttFU">
|
|
<img src="./thumbnail1-button.png" height="85%" width="85%%"/>
|
|
</a>
|
|
</div>
|
|
|
|
## GitHub
|
|
You can find the GitHub from here; https://github.com/uygarkurt/Model-Merge
|
|
|
|
In this specific case, I typed `llama-3` into the open LLM leaderboard, took the best 3 models, merged them and created
|
|
a better ranking model wihtout any training.
|
|
|
|
As the main libraries we will be using [mergekit](https://github.com/arcee-ai/mergekit).
|
|
|
|
<br/>
|
|
<div align="center">
|
|
<a href="">
|
|
<img alt="open-source-image"
|
|
src="https://img.shields.io/badge/%E2%9D%A4%EF%B8%8F_Open_Source-%2350C878?style=for-the-badge"/>
|
|
</a>
|
|
<a href="https://youtu.be/gNXBp3wttFU">
|
|
<img alt="youtube-tutorial"
|
|
src="https://img.shields.io/badge/YouTube_Tutorial-grey?style=for-the-badge&logo=YouTube&logoColor=%23FF0000"/>
|
|
</a>
|
|
<a href="https://github.com/uygarkurt/Model-Merge">
|
|
<img alt="github-image"
|
|
src="https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white"
|
|
</a>
|
|
</div> |