uavdt-rfdetr-medium

RF-DETR Medium Finetuned on UAVDT

Fine-tuned RF-DETR Medium object detector on the UAVDT benchmark dataset, trained and evaluated as part of DetectionBench -- a framework for reproducibly benchmarking modern object detectors with identical training recipes and evaluation metrics across multiple real-world datasets.

<!-- Demo banner: side-by-side video of this checkpoint's detections on two UAVDT test clips. Media lives under assets/ in this repo. The <video> renders on the Hugging Face model page (absolute resolve/ URL); on GitHub the nested <img> poster is shown instead. --> <p align="center"><video controls autoplay loop muted playsinline width="900" poster="https://huggingface.co/dronefreak/uavdt-rfdetr-medium/resolve/main/assets/demo_banner_poster.jpg" src="https://huggingface.co/dronefreak/uavdt-rfdetr-medium/resolve/main/assets/demo_banner.mp4"><img src="https://huggingface.co/dronefreak/uavdt-rfdetr-medium/resolve/main/assets/demo_banner_poster.jpg" alt="RF-DETR Medium detections on two UAVDT test clips" width="900"></video></p> <br> <!-- ROW 1: Identity & Tech Stack --> <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;"> <img src="https://img.shields.io/badge/Task-Object_Detection-blue?style=flat-square" alt="Task"> <img src="https://img.shields.io/badge/Framework-RF--DETR-0aa1a7?style=flat-square" alt="Framework"> <img src="https://img.shields.io/badge/Base_Model-RF--DETR_Medium-purple?style=flat-square" alt="Base Model"> </div> <!-- ROW 2: Performance Metrics --> <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;"> <img src="https://img.shields.io/badge/[email protected]%25-success?style=flat-square" alt="mAP@50"> <img src="https://img.shields.io/badge/mAP@50:95-20.54%25-orange?style=flat-square" alt="mAP@50:95"> <img src="https://img.shields.io/badge/Params-33.7M-lightgrey?style=flat-square" alt="Params"> </div> <!-- ROW 3: Metadata --> <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 24px; flex-wrap: wrap;"> <img src="https://img.shields.io/badge/License-Apache--2.0-lightgrey?style=flat-square" alt="License"> <a href="https://github.com/dronefreak/DetectionBench"><img src="https://img.shields.io/badge/Source-DetectionBench-black?style=flat-square" alt="Source"></a> </div>

---

Usage

Install Dependencies

pip install rfdetr huggingface_hub

Load Model from Hugging Face

from huggingface_hub import hf_hub_download
import rfdetr

weights = hf_hub_download(
    repo_id="dronefreak/uavdt-rfdetr-medium",
    filename="checkpoint_best_total.pth"
)

model = rfdetr.RFDETRMedium(pretrain_weights=weights)

Run Inference

detections = model.predict("image.jpg", threshold=0.25)

---

Performance

Evaluated on the UAVDT test split, using DetectionBench's standard evaluation pipeline (detectionbench-evaluate).

---

UAVDT Model Zoo

Every model DetectionBench has trained and evaluated on UAVDT so far, for full transparency -- see DetectionBench for the smaller, curated comparison set used on the project README.

---

Per-Class Performance

This model was evaluated with Supervision's detection metrics, which report mAP/Precision/Recall directly but don't produce a confusion-matrix plot the way Ultralytics' validator does.

---

Dataset

This model was trained on UAVDT. For the full dataset description, provenance, license, and citation, see the dataset card:

https://huggingface.co/datasets/dronefreak/UAVDT

Classes

• car
• truck
• bus

---

Training Configuration

---

Repository Contents

checkpoint_best_total.pth
metrics.csv
config.json
uavdt_rfdetr-medium_showcase.jpg
assets/demo_banner.mp4
assets/demo_banner_poster.jpg
README.md

---

Related Resources

• UAVDT dataset card on Hugging Face
• DetectionBench -- reproducible benchmarks for modern object detectors on real-world datasets
• UAVDT paper preprint (arXiv:1804.00518)
• UAVDT project website (official data source)

---

Training Framework

This model was trained using DetectionBench, an open-source framework for benchmarking object detectors across multiple real-world datasets with a common pipeline.

Features include:

• A dataset-adapter registry for converting real-world datasets into a canonical format
• Identical training/evaluation recipes across model families (Ultralytics YOLO/RT-DETR, RF-DETR)
• Hardware profiling (latency, FPS, VRAM, parameters, FLOPs)
• One-command reproducibility via versioned Hydra configs

If you find this model useful, please consider starring the repository.

---

Known Limitations

• Severe class imbalance: car (94.6%) dominates the annotated boxes, while truck (3.1%) and bus (2.3%) are rare -- per-class accuracy on the minority classes is measured on comparatively few examples, and every model here scores far lower on them than on car.
• Very small objects: the median box covers only 0.14% of the image area (mean 0.26%), so this is a hard small-object regime and absolute mAP values are low for every architecture; the numbers are best read as a relative comparison between models, not as a production-quality detector.
• Video-derived, highly correlated frames: the ~40.7k labelled images come from 50 video sequences, so consecutive frames are near-duplicates. UAVDT's 50 tracking-only sequences have no detection labels and are excluded. The validation split is carved out of the training sequences by sequence (not by frame) to avoid leakage, but effective diversity is far lower than the image count suggests.
• Different density per split: instances per image are 15.7 (train), 28.0 (valid) and 22.7 (test), because the splits contain different sequences -- validation metrics are not directly predictive of test metrics.
• Research-use-only data: UAVDT is distributed "for research purpose only" with no redistribution grant, so the dataset is not mirrored here -- obtain it from the official source (see the Dataset section above) and check its terms before any use beyond research.

---

Citation

If you use this model in your research, please consider citing the dataset and the model architecture:

@InProceedings{du2018unmanned,
  title={The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking},
  author={Du, Dawei and Qi, Yuankai and Yu, Hongyang and Yang, Yifan and Duan, Kaiwen and Li, Guorong and Zhang, Weigang and Huang, Qingming and Tian, Qi},
  booktitle={Proceedings of the European Conference on Computer Vision (ECCV)},
  year={2018}
}

@inproceedings{robinson2026rfdetr,
  title     = {RF-DETR: Real-Time Detection Transformer},
  author    = {Robinson, Isaac and Robicheaux, Peter and Popov, Matvei and Ramanan, Deva and Peri, Neehar},
  booktitle = {International Conference on Learning Representations (ICLR)},
  year      = {2026},
  url       = {https://arxiv.org/abs/2511.09554}
}

@article{oquab2023dinov2,
  title={DINOv2: Learning Robust Visual Features without Supervision},
  author={Oquab, Maxime and Darcet, Timoth{\'e}e and Moutakanni, Theo and Vo, Huy and Szafraniec, Marc and Khalidov, Vasil and Fernandez, Pierre and Haziza, Daniel and Massa, Francisco and El-Nouby, Alaaeldin and others},
  journal={arXiv preprint arXiv:2304.07193},
  year={2023}
}