pythia-70m-ppo

usvsnsp/pythia-70m-ppo

pythia-70m-ppo is a text generation model from usvsnsp. Use it when you need the model to write or continue text. It is set up for transformers.

Wandb Run: https://wandb.ai/eleutherai/pythia-rlhf/runs/gy2g8jj1

Downloads · 30 days

2% of all-time downloads

All-time downloads

807

Public

Parameters

96.1M

657 MB on disk

Likes

Public

Repo makeup

Click a slice to open those files.

.bin348 MB · 53%

How the weights are stored.

F3271M · 74%

From the Hugging Face model README

Model Evals:

Tasks	Version	Filter	Metric	Value		Stderr
arc_challenge	Yaml	none	acc	0.2253	±	0.0122
		none	acc_norm	0.2278	±	0.0123
arc_easy	Yaml	none	acc	0.2551	±	0.0089
		none	acc_norm	0.2567	±	0.0090
lambada_openai	Yaml	none	perplexity	NaN	±	NaN
		none	acc	0.0016	±	0.0005
logiqa	Yaml	none	acc	0.2028	±	0.0158
		none	acc_norm	0.2028	±	0.0158
piqa	Yaml	none	acc	0.4946	±	0.0117
		none	acc_norm	0.4924	±	0.0117
sciq	Yaml	none	acc	0.0140	±	0.0037
		none	acc_norm	0.0140	±	0.0037
winogrande	Yaml	none	acc	0.5036	±	0.0141
wsc	Yaml	none	acc	0.6346	±	0.0474