Downloads · 30 days
0
topk-staircase-share.shakespeare_64x4
davidquarel/topk-staircase-share.shakespeare_64x4
topk-staircase-share.shakespeare_64x4 is a machine learning model from davidquarel. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
The proposed Staircase SAE architecture using Top- K activation, as described in Section 3. The total number of features N = n × (L + 1) was chosen such that the total parameter count is comparable to the Topk and Top…
Access
Public
Updated May 8, 2025
Parameters
216K
2.2 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 MB · 95%
At a glance
- Access
- Public
- Created
- Mar 27, 2025
- Updated
- May 8, 2025
- SHA
- f9309f0a
Model card
From the Hugging Face model README
The proposed Staircase SAE architecture using Top- K activation, as described in Section 3. The total number of features N = n × (L + 1) was chosen such that the total parameter count is comparable to the Topk and Topk-Staircase-Tied-All models.
This is what you want if you want the staircase model. Use this one.
- Created
- Mar 27, 2025
- Updated
- May 8, 2025