tylercosgrove

mistral-7b-sparse-autoencoder-layer16

tylercosgrove/mistral-7b-sparse-autoencoder-layer16

mistral-7b-sparse-autoencoder-layer16 is a machine learning model from tylercosgrove. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This contains the weights of a sparse autoencoder I trained on the residual activations of Mistral-7B-Instruct-v0.1. I used The Pile (uncopyrighted) for the training data. As of right now, I have only trained a single…