sabersaleh

Llama2-7B-KTO

sabersaleh/Llama2-7B-KTO

Llama2-7B-KTO is a machine learning model from sabersaleh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This model is aligned using the AlpacaFarm dataset, fine-tuned through the Kahneman-Tversky Optimization (KTO) loss. The alignment process started from the Supervised Fine-Tuned (SFT) version of LLaMA 2 7B. The optimi…