djroytburg

dpo_self_preference_llama_aware

djroytburg/dpo_self_preference_llama_aware

dpo_self_preference_llama_aware is a machine learning model from djroytburg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

- Developed by: djroytburg - License: apache-2.0 - Finetuned from model : unsloth/llama-3.1-8b-instruct-unsloth-bnb-4bit