hrp4k-rfdetr-medium

RF-DETR Medium Finetuned on HRP4K

Fine-tuned RF-DETR Medium object detector on the HRP4K benchmark dataset, trained and evaluated as part of DetectionBench -- a framework for reproducibly benchmarking modern object detectors with identical training recipes and evaluation metrics across multiple real-world datasets.

<p align="center"> <img src="hrp4k_rfdetr-medium_showcase.jpg" alt="HRP4K Detection Demo" width="900"> </p> <br> <!-- ROW 1: Identity & Tech Stack --> <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;"> <img src="https://img.shields.io/badge/Task-Object_Detection-blue?style=flat-square" alt="Task"> <img src="https://img.shields.io/badge/Framework-RF--DETR-0aa1a7?style=flat-square" alt="Framework"> <img src="https://img.shields.io/badge/Base_Model-RF--DETR_Medium-purple?style=flat-square" alt="Base Model"> </div> <!-- ROW 2: Performance Metrics --> <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;"> <img src="https://img.shields.io/badge/[email protected]%25-success?style=flat-square" alt="mAP@50"> <img src="https://img.shields.io/badge/mAP@50:95-31.81%25-orange?style=flat-square" alt="mAP@50:95"> <img src="https://img.shields.io/badge/Params-33.7M-lightgrey?style=flat-square" alt="Params"> </div> <!-- ROW 3: Metadata --> <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 24px; flex-wrap: wrap;"> <img src="https://img.shields.io/badge/License-Apache--2.0-lightgrey?style=flat-square" alt="License"> <a href="https://github.com/dronefreak/DetectionBench"><img src="https://img.shields.io/badge/Source-DetectionBench-black?style=flat-square" alt="Source"></a> </div>

---

Usage

Install Dependencies

pip install rfdetr huggingface_hub

Load Model from Hugging Face

from huggingface_hub import hf_hub_download
import rfdetr

weights = hf_hub_download(
    repo_id="dronefreak/hrp4k-rfdetr-medium",
    filename="checkpoint_best_total.pth"
)

model = rfdetr.RFDETRMedium(pretrain_weights=weights)

Run Inference

detections = model.predict("image.jpg", threshold=0.25)

---

Performance

Evaluated on the HRP4K test split, using DetectionBench's standard evaluation pipeline (detectionbench-evaluate).

---

HRP4K Model Zoo

Every model DetectionBench has trained and evaluated on HRP4K so far, for full transparency -- see DetectionBench for the smaller, curated comparison set used on the project README.

---

Per-Class Performance

This model was evaluated with Supervision's detection metrics, which report mAP/Precision/Recall directly but don't produce a confusion-matrix plot the way Ultralytics' validator does.

---

Dataset

This model was trained on HRP4K. For the full dataset description, provenance, license, and citation, see the dataset card:

https://huggingface.co/datasets/dronefreak/HRP4K

Classes

• pothole

---

Training Configuration

---

Repository Contents

checkpoint_best_total.pth
metrics.csv
config.json
hrp4k_rfdetr-medium_showcase.jpg
README.md

---

Related Resources

• HRP4K dataset card on Hugging Face
• DetectionBench -- reproducible benchmarks for modern object detectors on real-world datasets
• HRP4K paper (Scientific Data, doi:10.1038/s41597-026-07317-w)
• HRP4K dataset record (Zenodo, doi:10.5281/zenodo.17522874)
• HRP4K project repository

---

Training Framework

This model was trained using DetectionBench, an open-source framework for benchmarking object detectors across multiple real-world datasets with a common pipeline.

Features include:

• A dataset-adapter registry for converting real-world datasets into a canonical format
• Identical training/evaluation recipes across model families (Ultralytics YOLO/RT-DETR, RF-DETR)
• Hardware profiling (latency, FPS, VRAM, parameters, FLOPs)
• One-command reproducibility via versioned Hydra configs

If you find this model useful, please consider starring the repository.

---

Known Limitations

• Incomplete upstream train split: the official train.json references 4,203 images, but the released archive ships only 2,286 of them, so the training set here is 2,286 images with 2,790 boxes (the validation and test splits are complete at 900 images each).
• Single class, sparse targets: every box is a pothole, with only about 1.2 boxes per image, and roughly a third of the images in every split contain no pothole at all (789 of 2,286 train, 300 of 900 valid, 300 of 900 test). Those empty test frames mean a false positive on a clean road directly lowers precision.
• Small targets in very large frames: every image is 3840x2160 (4K), and the median pothole is only about 61 px wide on the native frame (0.05% of the image area; the smallest 5% are under 16 px), so results depend strongly on the input resolution the model was trained and evaluated at -- at 640 px most potholes shrink to a few pixels.
• Wide, perspective-view boxes: the median box is about 2.9 times wider than tall, reflecting the dataset's road-surface perspective, so generalization to other camera positions (e.g. aerial or vehicle mounted) is untested.
• Small test split: 900 images with 921 boxes, so differences of about one mAP point between models are within noise and should be read with caution.

---

Citation

If you use this model in your research, please consider citing the dataset and the model architecture:

@article{chen2026hrp4k,
  title={A high-resolution perspective-view road image dataset for pothole detection},
  author={Chen, Hanshen and Tu, Zhoulin and Zhao, Yu and Ye, Jianfeng},
  journal={Scientific Data},
  volume={13},
  pages={961},
  year={2026},
  doi={10.1038/s41597-026-07317-w}
}

@inproceedings{robinson2026rfdetr,
  title     = {RF-DETR: Real-Time Detection Transformer},
  author    = {Robinson, Isaac and Robicheaux, Peter and Popov, Matvei and Ramanan, Deva and Peri, Neehar},
  booktitle = {International Conference on Learning Representations (ICLR)},
  year      = {2026},
  url       = {https://arxiv.org/abs/2511.09554}
}

@article{oquab2023dinov2,
  title={DINOv2: Learning Robust Visual Features without Supervision},
  author={Oquab, Maxime and Darcet, Timoth{\'e}e and Moutakanni, Theo and Vo, Huy and Szafraniec, Marc and Khalidov, Vasil and Fernandez, Pierre and Haziza, Daniel and Massa, Francisco and El-Nouby, Alaaeldin and others},
  journal={arXiv preprint arXiv:2304.07193},
  year={2023}
}