Downloads · 30 days
0
anonymous_bbnlp_2024_submission
anonymous-18234781/anonymous_bbnlp_2024_submission
anonymous_bbnlp_2024_submission is a machine learning model from anonymous-18234781. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.
Gemma Scope is a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying c…
Access
Public
Updated Aug 13, 2024
Repo size
302 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.npz302 MB · 100%
At a glance
- License
- cc-by-4.0
- Access
- Public
- Created
- Aug 13, 2024
- Updated
- Aug 13, 2024
- SHA
- 9fbcadc1
Model card
From the Hugging Face model README
Gemma Scope [review version for BlackboxNLP 2024]
Gemma Scope is a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying concepts, just as biologists use microscopes to study the individual cells of plants and animals.
Check out our Google Colab notebook tutorial for how to use Gemma Scope.
Each Sparse Autoencoder learns many latent representations that seem to correspond to human understandable concepts. Here we showcase a latent representation that corresponds to sentences about time and space travel.
<img src="feature_dashboard.png" width=600 height=600>- License
- cc-by-4.0
- Created
- Aug 13, 2024
- Updated
- Aug 13, 2024