llama-3-merged-linear

LLM Model Merging

YouTube Tutorial

<div align="center"> <a href="https://youtu.be/gNXBp3wttFU">Model Merging: Merge LLMs to Create Frankestein Models - Python, HuggingFace, Mergekit</a> <br> <br> <a href="https://youtu.be/gNXBp3wttFU"> <img src="./thumbnail1-button.png" height="85%" width="85%%"/> </a> </div>

GitHub

You can find the GitHub from here; https://github.com/uygarkurt/Model-Merge

In this specific case, I typed llama-3 into the open LLM leaderboard, took the best 3 models, merged them and created a better ranking model wihtout any training.

As the main libraries we will be using mergekit.

<br/> <div align="center"> <a href=""> <img alt="open-source-image" src="https://img.shields.io/badge/%E2%9D%A4%EF%B8%8F_Open_Source-%2350C878?style=for-the-badge"/> </a> <a href="https://youtu.be/gNXBp3wttFU"> <img alt="youtube-tutorial" src="https://img.shields.io/badge/YouTube_Tutorial-grey?style=for-the-badge&logo=YouTube&logoColor=%23FF0000"/> </a> <a href="https://github.com/uygarkurt/Model-Merge"> <img alt="github-image" src="https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white" </a> </div>