Downloads · 30 days
276
10% of all-time downloads
lomahony/eleuther-pythia410m-hh-dpo
eleuther-pythia410m-hh-dpo is a text generation model from lomahony. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Pythia-410m supervised finetuned with Anthropic-hh-rlhf dataset for 1 epoch (sft-model), before DPO (paper) with same dataset for 1 epoch.
Downloads · 30 days
276
10% of all-time downloads
All-time downloads
2.7K
Public
Parameters
506M
7.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.pt3.3 GB · 49%
How the weights are stored.
F32405M · 80%
From the Hugging Face model README
Pythia-410m supervised finetuned with Anthropic-hh-rlhf dataset for 1 epoch (sft-model), before DPO (paper) with same dataset for 1 epoch.
Benchmark evaluations included in repo done using lm-evaluation-harness.
See Pythia-410m for original model details (paper).