jacobcd52

gpt2-small-sparse-autoencoders

jacobcd52/gpt2-small-sparse-autoencoders

gpt2-small-sparse-autoencoders is a machine learning model from jacobcd52. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This directory contains sparse autoencoders trained on activations at various points within gpt2-small using Neel Nanda's open source code. Each autoencoder was trained on 1B tokens from OpenWebText. A demo colab note…