Downloads · 30 days
0
0% of all-time downloads
vit-dino-base16
probing-vits/vit-dino-base16
vit-dino-base16 is a machine learning model from probing-vits. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for keras.
This model is a TensorFlow port of DINO [1] ViT B-16 [2]. The backbone of this model was pre-trained using the DINO pretext task. After that its head layer was trained by keeping the backbone frozen. ImageNet-1k datas…
All-time downloads
2.8K
Public
Repo size
355 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.data-00000-of-00001350 MB · 98%
At a glance
- Library
- keras
- Access
- Public
- Created
- Apr 11, 2022
- Updated
- Apr 12, 2022
- SHA
- 8edf398a
Model card
From the Hugging Face model README
This model is a TensorFlow port of DINO [1] ViT B-16 [2]. The backbone of this model was pre-trained using the DINO pretext task. After that its head layer was trained by keeping the backbone frozen. ImageNet-1k dataset was used for training purposes. You can refer to this notebook to know how the porting was done.
References
[1] Emerging Properties in Self-Supervised Vision Transformers: https://arxiv.org/abs/2104.14294
[2] An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929
- Library
- keras
- Created
- Apr 11, 2022
- Updated
- Apr 12, 2022