Downloads · 30 days
18
5% of all-time downloads
groderg/DroneBeit-base-patch16-384-2025_11_09_24127-bs32_freeze_probs
DroneBeit-base-patch16-384-2025_11_09_24127-bs32_freeze_probs is a machine learning model from groderg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc0-1.0.
DroneBeit is a fine-tuned version of DroneBeit-base-patch16-384-2025110924127-bs32freezeprobs. It achieves the following results on the test set:
Downloads · 30 days
18
5% of all-time downloads
All-time downloads
331
Public
Parameters
85.7M
14.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors343 MB · 100%
From the Hugging Face model README
DroneBeit is a fine-tuned version of DroneBeit-base-patch16-384-2025_11_09_24127-bs32_freeze_probs. It achieves the following results on the test set:
DroneBeit is a model built on top of DroneBeit-base-patch16-384-2025_11_09_24127-bs32_freeze_probs model for underwater multilabel image classification.The classification head is a combination of linear, ReLU, batch normalization, and dropout layers.
The source code for training the model can be found in this Git repository.
You can use the raw model for classify diverse marine species, encompassing coral morphotypes classes taken from the Global Coral Reef Monitoring Network (GCRMN), habitats classes and seagrass species.
Details on the estimated number of images for each class are given in the following table:
| Class | train | test | val | Total |
|---|---|---|---|---|
| Acropore_branched | 1400 | 331 | 324 | 2055 |
| Acropore_digitised | 1235 | 307 | 296 | 1838 |
| Acropore_tabular | 705 | 254 | 270 | 1229 |
| Algae | 5179 | 1709 | 1694 | 8582 |
| Atra/Leucospilota | 780 | 121 | 133 | 1034 |
| Dead_coral | 3796 | 1093 | 1060 | 5949 |
| Fish | 2822 | 810 | 786 | 4418 |
| Millepore | 977 | 324 | 337 | 1638 |
| No_acropore_encrusting | 854 | 417 | 404 | 1675 |
| No_acropore_massive | 3430 | 1180 | 1185 | 5795 |
| No_acropore_sub_massive | 3261 | 975 | 935 | 5171 |
| Rock | 5251 | 1740 | 1737 | 8728 |
| Rubble | 5152 | 1708 | 1690 | 8550 |
| Sand | 5285 | 1764 | 1767 | 8816 |
| Sea_cucumber | 1942 | 497 | 527 | 2966 |
| Sea_urchins | 269 | 131 | 140 | 540 |
The following hyperparameters were used during training:
Data were augmented using the following transformations :
Train Transforms
Val Transforms
| Epoch | Validation Loss | MAE | RMSE | KL div | Learning Rate |
|---|---|---|---|---|---|
| 1 | 0.46537673473358154 | 0.1427 | 0.1911 | 0.5951 | 0.001 |
| 2 | 0.4668998420238495 | 0.1429 | 0.1917 | 0.5244 | 0.001 |
| 3 | 0.4603305459022522 | 0.1356 | 0.1866 | 1.1697 | 0.001 |
| 4 | 0.4649343490600586 | 0.1424 | 0.1904 | 0.3369 | 0.001 |
| 5 | 0.4623628556728363 | 0.1404 | 0.1880 | 0.3404 | 0.001 |
| 6 | 0.4670265018939972 | 0.1379 | 0.1926 | 1.7421 | 0.001 |
| 7 | 0.4586734175682068 | 0.1373 | 0.1848 | 0.4292 | 0.001 |
| 8 | 0.4571555256843567 | 0.1351 | 0.1842 | 0.9546 | 0.001 |
| 9 | 0.45698973536491394 | 0.1359 | 0.1835 | 0.6684 | 0.001 |
| 10 | 0.45804569125175476 | 0.1335 | 0.1846 | 0.9857 | 0.001 |
| 11 | 0.4552794396877289 | 0.1316 | 0.1815 | 0.8538 | 0.001 |
| 12 | 0.4591791033744812 | 0.1365 | 0.1853 | 0.5236 | 0.001 |
| 13 | 0.4572516679763794 | 0.1353 | 0.1842 | 1.1577 | 0.001 |
| 14 | 0.4574100375175476 | 0.1333 | 0.1833 | 0.8590 | 0.001 |
| 15 | 0.4618110954761505 | 0.1402 | 0.1873 | 0.2479 | 0.001 |
| 16 | 0.4545270800590515 | 0.1340 | 0.1814 | 0.7286 | 0.001 |
| 17 | 0.4554501473903656 | 0.1330 | 0.1818 | 0.7371 | 0.001 |
| 18 | 0.45703229308128357 | 0.1351 | 0.1834 | 0.5551 | 0.001 |
| 19 | 0.45742470026016235 | 0.1340 | 0.1836 | 0.6165 | 0.001 |
| 20 | 0.4566545784473419 | 0.1344 | 0.1828 | 0.7220 | 0.001 |
| 21 | 0.4572252035140991 | 0.1338 | 0.1831 | 0.6033 | 0.001 |
| 22 | 0.4604697823524475 | 0.1359 | 0.1857 | 0.3166 | 0.001 |
| 23 | 0.45426449179649353 | 0.1332 | 0.1806 | 0.4961 | 0.0001 |
| 24 | 0.4529441297054291 | 0.1326 | 0.1797 | 0.6911 | 0.0001 |
| 25 | 0.45374155044555664 | 0.1333 | 0.1804 | 0.6251 | 0.0001 |
| 26 | 0.4525921940803528 | 0.1320 | 0.1795 | 0.7885 | 0.0001 |
| 27 | 0.4528833329677582 | 0.1321 | 0.1795 | 0.6495 | 0.0001 |
| 28 | 0.4543718099594116 | 0.1335 | 0.1809 | 0.4693 | 0.0001 |
| 29 | 0.45217621326446533 | 0.1322 | 0.1791 | 0.6915 | 0.0001 |
| 30 | 0.45320871472358704 | 0.1324 | 0.1798 | 0.5327 | 0.0001 |
| 31 | 0.45279088616371155 | 0.1324 | 0.1796 | 0.6198 | 0.0001 |
| 32 | 0.45295798778533936 | 0.1327 | 0.1797 | 0.6107 | 0.0001 |
| 33 | 0.4531444311141968 | 0.1324 | 0.1799 | 0.5674 | 0.0001 |
| 34 | 0.4536915421485901 | 0.1334 | 0.1802 | 0.5047 | 0.0001 |
| 35 | 0.452108234167099 | 0.1320 | 0.1789 | 0.6637 | 0.0001 |
| 36 | 0.4525606632232666 | 0.1318 | 0.1794 | 0.7657 | 0.0001 |
| 37 | 0.4529743492603302 | 0.1331 | 0.1799 | 0.6830 | 0.0001 |
| 38 | 0.45398780703544617 | 0.1338 | 0.1806 | 0.5799 | 0.0001 |
| 39 | 0.4528484046459198 | 0.1309 | 0.1798 | 1.0170 | 0.0001 |
| 40 | 0.45289087295532227 | 0.1325 | 0.1795 | 0.5855 | 0.0001 |
| 41 | 0.45224177837371826 | 0.1317 | 0.1792 | 0.8217 | 0.0001 |
| 42 | 0.4523595869541168 | 0.1323 | 0.1791 | 0.6736 | 1e-05 |
| 43 | 0.4523925185203552 | 0.1323 | 0.1791 | 0.6599 | 1e-05 |
| 44 | 0.4524300992488861 | 0.1322 | 0.1791 | 0.6418 | 1e-05 |
| 45 | 0.4524487257003784 | 0.1322 | 0.1791 | 0.6358 | 1e-05 |