Downloads · 30 days
45
1% of all-time downloads
pythia-intervention-70m-deduped
EleutherAI/pythia-intervention-70m-deduped
pythia-intervention-70m-deduped is a text generation model from EleutherAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is part of an intervention study done in the paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling where we replaced all masculine pronouns with femanine ones and retrained t…
All-time downloads
5K
Public
Repo size
1.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin166 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Mar 5, 2023
- Updated
- May 1, 2023
- SHA
- 5181c967
Try a prompt
Datasets
Model card
From the Hugging Face model README
This model is part of an intervention study done in the paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling where we replaced all masculine pronouns with femanine ones and retrained the model for the last 21 billion tokens. The regular model can be found here.
We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Created
- Mar 5, 2023
- Updated
- May 1, 2023