fm-overspecialization-MAE-Large-HyperF_Type

MAE-Large (HyperF_type)

Classification of hyperfluorescence type on Fluorescein Angiography (FA) images.

Multiclass problem: 0 (leakage), 1 (staining), 2 (no), 3 (pooling), 4 (window defect)

This model is obtained by finetuning the pretrained architecture of HuggingFace vit_large_patch16_224.mae.

Trained on: AngioReport

Usage

Check instruction at the following repository

Model output structure

[batch_size, num_classes] (num_classes=5)

Related publication(s)

@article{xu_angioreport_2025,
        title = {{AngioReport}: dataset and baseline methods for fundus angiography report generation},
        issn = {0007-1161},
        url = {https://bjo.bmj.com/content/early/2025/07/02/bjo-2024-327006},
        doi = {10.1136/bjo-2024-327006},
        journal = {British Journal of Ophthalmology},
        author = {Xu, Pusheng and Chotcomwongse, Peranut and Zhang, Weiyi and Chen, Xiaolan and Wu, Xinyuan and Chung, Florence H T and Zhang, Xueli and He, Mingguang and Shi, Danli and Ruamviboonsuk, Paisan},
        year = {2025},
}
@misc{he2021maskedautoencodersscalablevision,
        title={Masked Autoencoders Are Scalable Vision Learners},
        author={Kaiming He and Xinlei Chen and Saining Xie and Yanghao Li and Piotr Dollár and Ross Girshick},
        year={2021},
        eprint={2111.06377},
        archivePrefix={arXiv},
        primaryClass={cs.CV},
        url={https://arxiv.org/abs/2111.06377},
}

Author(s)

• Roberto Pulvirenti, Idiap Research Institute