sabersaleh

Llama2-7B-IPO

sabersaleh/Llama2-7B-IPO

Llama2-7B-IPO is a machine learning model from sabersaleh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This model is aligned using the AlpacaFarm dataset, fine-tuned through the Identity Policy Optimization (IPO) loss. The alignment process started from the Supervised Fine-Tuned (SFT) version of LLaMA 2 7B. The optimiz…