Downloads · 30 days
0
SAE-Phi-3-mini-4k-instruct
analist/SAE-Phi-3-mini-4k-instruct
SAE-Phi-3-mini-4k-instruct is a machine learning model from analist. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for saelens.
These are trained Sparse Autoencoders (SAEs) for the microsoft/Phi-3-mini-4k-instruct model, compatible with the saelens library.
Access
Public
Updated Jun 8, 2026
Repo size
189 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt185 GB · 99%
At a glance
- Library
- saelens
- Access
- Public
- Created
- Jun 6, 2026
- Updated
- Jun 8, 2026
- SHA
- 7428d984
Model card
From the Hugging Face model README
Sparse Autoencoders for Phi-3-mini-4k-instruct
These are trained Sparse Autoencoders (SAEs) for the microsoft/Phi-3-mini-4k-instruct model, compatible with the sae_lens library.
Repository Structure
layer_{L}/- Contains the final SAELens-compatible SAFETENSORS for each target layer.checkpoints/- Contains the intermediate PyTorch.ptstep checkpoints saved during training.
Model Details
- Model:
microsoft/Phi-3-mini-4k-instruct - Layers: [21, 22, 23]
- Architecture: Standard (ReLU) with pre-encoder centring (
b_decapplied to input). - Expansion Factor: 16x (49152 features)
- Tokens Trained: ~1034M
Datasets
- NuminaMath-CoT: 40%
- HH-RLHF: 20%
- FineWeb: 20%
- JBB/HarmBench/AdvBench: 20%
Usage with SAELens
from sae_lens import SAE
# Load the final SAE for a specific layer, e.g., layer 21
sae, cfg_dict, sparsity = SAE.from_pretrained(
release="analist/SAE-Phi-3-mini-4k-instruct",
sae_id="layer_21",
device="cuda"
)
- Library
- saelens
- Created
- Jun 6, 2026
- Updated
- Jun 8, 2026