Skip to content

lomahony

eleuther-pythia6.9b-hh-dpo

lomahony/eleuther-pythia6.9b-hh-dpo

eleuther-pythia6.9b-hh-dpo is a text generation model from lomahony. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Pythia-6.9b supervised finetuned with Anthropic-hh-rlhf dataset for 1 epoch (sft-model), before DPO (paper) with same dataset for 1 epoch.

Downloads · 30 days

83

2% of all-time downloads

All-time downloads

4.5K

Public

Repo size

13.8 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin13.8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
gpt_neox
Access
Public
Created
Aug 7, 2023
Updated
Aug 12, 2023
SHA
f9eae2bc

Try a prompt

Task
Text Generation
Library
transformers
Type
gpt_neox
License
apache-2.0
Languages
en
Created
Aug 7, 2023
Updated
Aug 12, 2023