Downloads · 30 days
51
1% of all-time downloads
pythia-intervention-1.4b-deduped
EleutherAI/pythia-intervention-1.4b-deduped
pythia-intervention-1.4b-deduped is a text generation model from EleutherAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is part of an intervention study done in the paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling where we replaced all masculine pronouns with femanine ones and retrained t…
All-time downloads
4.8K
Public
Repo size
32.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Mar 8, 2023
- Updated
- May 1, 2023
- SHA
- 5fb4ac77
Try a prompt
Datasets
Model card
From the Hugging Face model README
This model is part of an intervention study done in the paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling where we replaced all masculine pronouns with femanine ones and retrained the model for the last 21 billion tokens. The corresponding regular model can be found here.
We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Created
- Mar 8, 2023
- Updated
- May 1, 2023