vit-eurosat

ViT Fine-Tuned on EuroSAT

This model is a fine-tuned version of google/vit-base-patch16-224 for satellite land-cover classification on the EuroSAT dataset.

Model Details

• Architecture: Vision Transformer (ViT)
• Base model: google/vit-base-patch16-224
• Task: Image Classification
• Dataset: EuroSAT
• Number of classes: 10
• Fine-tuning epochs: 3

Classes

• AnnualCrop
• Forest
• HerbaceousVegetation
• Highway
• Industrial
• Pasture
• PermanentCrop
• Residential
• River
• SeaLake

Evaluation Results

The model was evaluated on the held-out EuroSAT test split of 2,700 images.

For comparison, a fine-tuned ResNet50 trained on the same data split achieved:

ViT achieved higher classification performance in this experiment, while ResNet50 trained substantially faster.

Fine-Tuning

The pretrained ViT classification head was adapted to the 10 EuroSAT classes and the model was fine-tuned end to end using Hugging Face Transformers.

Training configuration:

• Optimizer: AdamW
• Learning rate: 5e-5
• Weight decay: 0.01
• Epochs: 3
• Best checkpoint selected using validation macro F1

Usage

from transformers import pipeline

classifier = pipeline(
    "image-classification",
    model="Haifald/vit-eurosat"
)

predictions = classifier("path_to_image.jpg")
print(predictions)

Limitations

• Results are based on one EuroSAT experiment and one dataset split.
• Performance on other satellite datasets was not evaluated.
• Training time depends on the hardware environment.

Project

Full experiment and comparison with ResNet50: GitHub link will be added after the repository is published.