Downloads · 30 days
0
clip_vit_sae
kdkang/clip_vit_sae
clip_vit_sae is a machine learning model from kdkang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Access
Public
Updated May 30, 2024
Repo size
1.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth491 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- May 15, 2024
- Updated
- May 30, 2024
- SHA
- 05d1136a
Model card
From the Hugging Face model README
| SAE | L0 | Reconstruction loss |
|---|---|---|
| All_layers_16 | 22.6794 | 0.0096 |
| All_layers_32 | 22.765 | 0.0098 |
| Layer0_ratio8_epochs100_lr1e-05 (16) | 6.3036 | 0.0063 |
| Layer1_ratio8_epochs100_lr1e-05 (16) | 8.7484 | 0.0086 |
| Layer2_ratio8_epochs100_lr1e-05 (16) | 7.0273 | 0.0069 |
| Layer3_ratio8_epochs100_lr1e-05 (16) | 6.2084 | 0.0075 |
| Layer4_ratio8_epochs100_lr1e-05 (16) | 7.7776 | 0.0074 |
| Layer5_ratio8_epochs100_lr1e-05 (16) | 10.8261 | 0.0077 |
| Layer6_ratio8_epochs100_lr1e-05 (16) | 17.8058 | 0.0069 |
| Layer7_ratio8_epochs100_lr1e-05 (16) | 15.4603 | 0.0083 |
| Layer8_ratio8_epochs100_lr1e-05 (16) | 16.5676 | 0.0114 |
| Layer9_ratio8_epochs100_lr1e-05 (16) | 37.6558 | 0.0112 |
| Layer10_ratio8_epochs100_lr1e-05 (16) | 59.9562 | 0.0162 |
| Layer11_ratio8_epochs100_lr1e-05 (16) | 30.2839 | 0.0092 |
| Layer0_ratio8_epochs100_lr1e-05 (32) | 12.7337 | 0.0066 |
| Layer1_ratio8_epochs100_lr1e-05 (32) | 12.8687 | 0.0135 |
| Layer2_ratio8_epochs100_lr1e-05 (32) | 6.8775 | 0.0104 |
| Layer3_ratio8_epochs100_lr1e-05 (32) | 6.045 | 0.0083 |
| Layer4_ratio8_epochs100_lr1e-05 (32) | 4.7725 | 0.0083 |
| Layer5_ratio8_epochs100_lr1e-05 (32) | 6.4063 | 0.0084 |
| Layer6_ratio8_epochs100_lr1e-05 (32) | 12.0487 | 0.0079 |
| Layer7_ratio8_epochs100_lr1e-05 (32) | 21.5325 | 0.0076 |
| Layer8_ratio8_epochs100_lr1e-05 (32) | 34.1275 | 0.0110 |
| Layer9_ratio8_epochs100_lr1e-05 (32) | 57.7212 | 0.0131 |
| Layer10_ratio8_epochs100_lr1e-05 (32) | 55.0687 | 0.0135 |
| Layer11_ratio8_epochs100_lr1e-05 (32) | 30.2875 | 0.0075 |
- License
- mit
- Created
- May 15, 2024
- Updated
- May 30, 2024