Downloads · 30 days
0
llama-3.2-1b-sae
Aquinlabs/llama-3.2-1b-sae
llama-3.2-1b-sae is a machine learning model from Aquinlabs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for aquin. The card lists the license as llama3.2.
Sparse autoencoders for meta-llama/Llama-3.2-1B-Instruct.
Access
Public
Updated Jul 19, 2026
Repo size
8.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt8.6 GB · 100%
At a glance
- Library
- aquin
- License
- llama3.2
- Access
- Public
- Created
- Jul 19, 2026
- Updated
- Jul 19, 2026
- SHA
- 87f22d53
Base models
Model card
From the Hugging Face model README
Llama 3.2 1B SAEs (layers 0–15)
Sparse autoencoders for meta-llama/Llama-3.2-1B-Instruct.
Layout
layer0_32768_top32/
sae.pt
meta.json
...
layer15_32768_top32/
sae.pt
meta.json
umap_points.json
Specs
| Field | Value |
|---|---|
| Base model | meta-llama/Llama-3.2-1B-Instruct |
| Layers | 0–15 (16 SAEs) |
d_model | 2048 |
d_sae | 32768 |
| Activation | TopK (k=32) |
| Architecture | topk |
| Package size | ~8.1 GiB |
Files
sae.pt— SAE checkpoint for that layermeta.json— layer metadata (model_slug,layer,d_model,d_sae,k,arch)umap_points.json— feature UMAP coordinates
License
- Base model: Llama 3.2 Community License (Meta). Using these SAEs with Llama 3.2 remains subject to that license.
- Accept Meta’s license on Hugging Face before downloading/using the base model.
Acknowledgements
- Base model: meta-llama/Llama-3.2-1B-Instruct
- Library
- aquin
- License
- llama3.2
- Created
- Jul 19, 2026
- Updated
- Jul 19, 2026