resnet18-s2-v0.1.1

Resnet18 pretained on BigEarthNet v2.0 using Sentinel-2 bands

<!-- Optional images --> <!-- [Sentinel-1](https://sentinel.esa.int/web/sentinel/missions/sentinel-1) | [Sentinel-2](https://sentinel.esa.int/web/sentinel/missions/sentinel-2) :---:|:---: <a href="https://sentinel.esa.int/web/sentinel/missions/sentinel-1"><img src="https://raw.githubusercontent.com/wiki/lhackel-tub/ConfigILM/static/imgs/sentinel_2.jpg" style="font-size: 1rem; height: 10em; width: auto; margin-right: 1em" alt="Sentinel-2 Satellite"/> | <a href="https://sentinel.esa.int/web/sentinel/missions/sentinel-2"><img src="https://raw.githubusercontent.com/wiki/lhackel-tub/ConfigILM/static/imgs/sentinel_1.jpg" style="font-size: 1rem; height: 10em; width: auto; margin-right: 1em" alt="Sentinel-1 Satellite"/> -->

This model was trained on the BigEarthNet v2.0 (also known as reBEN) dataset using the Sentinel-2 bands. It was trained using the following parameters:

• Number of epochs: up to 100
  • with early stopping
    • after 5 epochs of no improvement
    • based on validation average precision (macro)
  • the weights published in this model card were obtained after 2 training epochs
• Batch size: 512
• Learning rate: 0.001
• Dropout rate: 0.375
• Drop Path rate: 0.0
• Learning rate scheduler: LinearWarmupCosineAnnealing for 10_000 warmup steps
• Optimizer: AdamW
• Seed: 42

The model was trained using the training script of the official BigEarthNet v2.0 (reBEN) repository. See details in this repository for more information on how to train the model given the parameters above.

The model was evaluated on the test set of the BigEarthNet v2.0 dataset with the following results:

Example

To use the model, download the codes that defines the model architecture from the official BigEarthNet v2.0 (reBEN) repository and load the model using the code below. Note, that you have to install configilm to use the provided code.

from reben_publication.BigEarthNetv2_0_ImageClassifier import BigEarthNetv2_0_ImageClassifier

model = BigEarthNetv2_0_ImageClassifier.from_pretrained("path_to/huggingface_model_folder")

e.g.

from reben_publication.BigEarthNetv2_0_ImageClassifier import BigEarthNetv2_0_ImageClassifier

model = BigEarthNetv2_0_ImageClassifier.from_pretrained(
  "BIFOLD-BigEarthNetv2-0/BENv2-resnet18-s2-v0.1.1")

If you use this model in your research or the provided code, please cite the following papers:

CITATION FOR DATASET PAPER

@article{hackel2024configilm,
  title={ConfigILM: A general purpose configurable library for combining image and language models for visual question answering},
  author={Hackel, Leonard and Clasen, Kai Norman and Demir, Beg{\"u}m},
  journal={SoftwareX},
  volume={26},
  pages={101731},
  year={2024},
  publisher={Elsevier}
}