Downloads · 30 days
0
tetrahedron-saes-full-attn
timaeus/tetrahedron-saes-full-attn
tetrahedron-saes-full-attn is a machine learning model from timaeus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for saelens.
This repository contains the following SAEs: - blocks.0.attn.hookz - blocks.1.attn.hookz - blocks.0.hookresidpre - blocks.0.hookresidpost - blocks.1.hookresidpost
Access
Public
Updated Sep 19, 2024
Repo size
42.1 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors42.1 MB · 100%
At a glance
- Library
- saelens
- Access
- Public
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024
- SHA
- 3d04cfb9
Model card
From the Hugging Face model README
SAEs for use with the SAELens library
This repository contains the following SAEs:
- blocks.0.attn.hook_z
- blocks.1.attn.hook_z
- blocks.0.hook_resid_pre
- blocks.0.hook_resid_post
- blocks.1.hook_resid_post
Load these SAEs using SAELens as below:
from sae_lens import SAE
sae, cfg_dict, sparsity = SAE.from_pretrained("timaeus/tetrahedron-saes-full-attn", "<sae_id>")
- Library
- saelens
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024