peihaowang

vit-anti-oversmoothing

peihaowang/vit-anti-oversmoothing

vit-anti-oversmoothing is a machine learning model from peihaowang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

The official checkpoint release of ICLR 2022 paper Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice.