Downloads · 30 days
5
2% of all-time downloads
sae-gpt2-layer6
sunday-goodfire/sae-gpt2-layer6
sae-gpt2-layer6 is a machine learning model from sunday-goodfire. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Sparse Autoencoder trained with Interp-Pal.
All-time downloads
276
Public
Repo size
179 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors944 MB · 93%
At a glance
- Access
- Public
- Created
- Jun 27, 2026
- Updated
- Jun 27, 2026
- SHA
- 507f4aee
Model card
From the Hugging Face model README
SAE: openai-community/gpt2 layer 6
Sparse Autoencoder trained with Interp-Pal.
Training config
- Model:
openai-community/gpt2 - Layer: 6
- d_sae: 6144 (8x)
- Training tokens: 100,000,000
- Dataset:
Skylion007/openwebtext
Metrics
- Loss: 0.0956
- L0: 3058.6
- Features cached: 4097
- Created
- Jun 27, 2026
- Updated
- Jun 27, 2026