Mbian

llm-sft-dpo-lora

Mbian/llm-sft-dpo-lora

llm-sft-dpo-lora is a text generation model from Mbian. Use it when you need the model to write or continue text. It is set up for transformers.

This repository provides a LoRA adapter fine-tuned with Direct Preference Optimization (DPO) for improving instruction-following behavior and safety alignment.