pythia-70m-sft-hh

yongzx/pythia-70m-sft-hh

pythia-70m-sft-hh is a text generation model from yongzx. Use it when you need the model to write or continue text. It is set up for transformers.

Wandb runs: https://wandb.ai/eleutherai/pythia-rlhf/runs/s0qdwbg6?workspace=user-yongzx

Downloads · 30 days

1% of all-time downloads

All-time downloads

547

Public

Repo size

18 GB

Likes

Public

Repo makeup

Click a slice to open those files.

.pt986 MB · 78%

From the Hugging Face model README

Evaluation results:

Task	Version	Filter	Metric	Value		Stderr
arc_challenge	Yaml	none	acc	0.1758	±	0.0111
		none	acc_norm	0.2176	±	0.0121
arc_easy	Yaml	none	acc	0.3742	±	0.0099
		none	acc_norm	0.3565	±	0.0098
logiqa	Yaml	none	acc	0.2058	±	0.0159
		none	acc_norm	0.2412	±	0.0168
piqa	Yaml	none	acc	0.5958	±	0.0114
		none	acc_norm	0.5941	±	0.0115
sciq	Yaml	none	acc	0.5930	±	0.0155
		none	acc_norm	0.5720	±	0.0157
winogrande	Yaml	none	acc	0.5154	±	0.0140
wsc	Yaml	none	acc	0.3654	±	0.0474
lambada_openai	Yaml	none	perplexity	730.2552	±	46.8739
		none	acc	0.1316	±	0.0047