vincentoh

gpt2-lora-aligned-orpo

vincentoh/gpt2-lora-aligned-orpo

gpt2-lora-aligned-orpo is a machine learning model from vincentoh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.