sabersaleh

Llama2-7B-DPO

sabersaleh/Llama2-7B-DPO

Llama2-7B-DPO is a machine learning model from sabersaleh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This model is aligned using the AlpacaFarm dataset, fine-tuned through the Direct Preference Optimization (DPO) loss. The alignment process started from the Supervised Fine-Tuned (SFT) version of LLaMA 2 7B. The optim…