Downloads · 30 days
68
1% of all-time downloads
pythia-intervention-410m-deduped
EleutherAI/pythia-intervention-410m-deduped
pythia-intervention-410m-deduped is a text generation model from EleutherAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is part of an intervention study done in the paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling where we replaced all masculine pronouns with femanine ones and retrained t…
All-time downloads
5.1K
Public
Parameters
506M
10 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin911 MB · 50%
Parameter types
How the weights are stored.
F16405M · 80%
Try a prompt
Datasets
Model card
From the Hugging Face model README
This model is part of an intervention study done in the paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling where we replaced all masculine pronouns with femanine ones and retrained the model for the last 21 billion tokens. The regular model can be found here.
We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Created
- Mar 3, 2023
- Updated
- Jul 9, 2023