lomahony

eleuther-pythia2.8b-hh-dpo

lomahony/eleuther-pythia2.8b-hh-dpo

eleuther-pythia2.8b-hh-dpo is a text generation model from lomahony. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Pythia-70m supervised finetuned with Anthropic-hh-rlhf dataset for 1 epoch (sft-model), before DPO (paper) with same dataset for 1 epoch.