Downloads · 30 days
3
3% of all-time downloads
sae-gpt2-layer8
sunday-goodfire/sae-gpt2-layer8
sae-gpt2-layer8 is a machine learning model from sunday-goodfire. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Sparse Autoencoder trained with Interp-Pal.
All-time downloads
120
Public
Repo size
24.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.1 GB · 97%
At a glance
- Access
- Public
- Created
- Jun 27, 2026
- Updated
- Jun 27, 2026
- SHA
- 24159365
Model card
From the Hugging Face model README
SAE: openai-community/gpt2 layer 8
Sparse Autoencoder trained with Interp-Pal.
Training config
- Model:
openai-community/gpt2 - Layer: 8
- d_sae: 24576 (32x)
- k: 32
- Training tokens: 100,000,000
- Dataset:
Skylion007/openwebtext
Metrics
- Loss: 0.0001
- L0: 32.0
- Features cached: 17071
- Created
- Jun 27, 2026
- Updated
- Jun 27, 2026