clearview-derain-nafnet

ClearView: Image Deraining with NAFNet (Mixed-Domain)

<p align="center"> <img src="demo_showcase.jpg" alt="ClearView demo showcase: rainy input vs. derained output across four scenes (NAFNet Mid)"/> </p>

A NAFNet [8] (nonlinear activation free network) trained on a blended synthetic + real-world rain set, selecting checkpoints against a blended real-world validation metric rather than a single benchmark, for a model that holds up across domains instead of maxing out one dataset's quirks. Not a mirror of someone else's checkpoint, see Citation.

---

Quickstart

Requires the ClearView library:

pip install git+https://github.com/dronefreak/clearview.git

from clearview.api import DerainingModel
from huggingface_hub import hf_hub_download

weights = hf_hub_download(repo_id="dronefreak/clearview-derain-nafnet", filename="clearview-derain-nafnet.pth")
model = DerainingModel.from_pretrained("nafnet", weights=weights)

clean = model.process("rainy_image.png", output_path="derained.png")

---

Training Data

5 sources combined via ClearView's --mix-config (recipe), oversampling the real-world sources 2x:

~62% synthetic / ~38% real by effective sampling weight (before oversampling: ~77%/23% by raw pair count).

Checkpoint selection uses a separate blended validation set (recipe): SPA-Data val (capped to 150 of 1,000 pairs so it can't dominate), RealRain-1k-H/L validation (112 each), and Rain100L (100) as a synthetic sanity anchor.

---

Detailed Test-Set Metrics

Full per-dataset breakdown across all 6 tracked metrics, computed on each source's own held-out test/eval split (not the blended validation set used for checkpoint selection during training).

Metric definitions:

• PSNR (Peak Signal-to-Noise Ratio, dB): pixel-level fidelity between the restored output and ground truth. Higher is better. The standard image-restoration metric, but insensitive to structural/perceptual quality on its own.
• SSIM (Structural Similarity Index, 0-1): perceptual similarity based on luminance, contrast, and structure. Higher is better, tracks human-perceived quality more closely than PSNR.
• MAE (Mean Absolute Error, normalized [0,1] pixel space): average per-pixel absolute intensity difference. Lower is better, less sensitive to outlier pixels than MSE.
• MSE (Mean Squared Error, normalized [0,1] pixel space): average per-pixel squared intensity difference, the term PSNR is derived from. Lower is better, penalizes large errors more heavily than MAE.
• Rain Removal Rate: ClearView-specific metric. Compares the Sobel-gradient ("high-frequency") residual energy of the output vs. ground truth against that of the input vs. ground truth: 1 - (residual after) / (residual before). 1.0 means perfect rain removal, 0.0 means no change, negative means the model added more high-frequency error than it removed (e.g. hallucinated detail or over-sharpening). Higher is better.
• NIQE (Natural Image Quality Evaluator): no-reference perceptual quality score. Its pristine reference statistics are refit per test set from that set's own clean images, so NIQE values are only comparable within the same row, not across rows, a NIQE of 800 on one dataset and 10 on another does not mean one output is 80x worse, the reference scale itself differs per dataset. Lower is better within a given row.

---

ClearView Model Comparison

How this model compares to the rest of the ClearView model zoo (PSNR / SSIM), same test sets and evaluation protocol for every model. Columns sorted highest to lowest by average PSNR across the 9 rain-only test sets.

All ClearView models trained under the identical mixed-domain recipe, only batch size/accumulation steps vary per architecture size. Histoformer is included as an external, inference-only reference point (original authors' checkpoint, not trained under this recipe), its strong AllWeather (rain+fog) score and comparatively weak scores on the rain-only test sets reflect that it was trained on a rain+fog+snow mix, while ClearView's current mix is rain-only.

---

Use Cases

Good for: dashcam/surveillance footage, photo restoration, real-world rain (not just synthetic-style streaks).

Limitations: no temporal consistency for video (processes frames independently); AllWeather rain+fog is an explicit out-of-scope stress test, fog was not in the training mix and this model is not expected to handle it.

---

Training

clearview-train --model nafnet --mix-config configs/mix/rain_mixed_synthetic_real.yaml --mix-sampler \
  --val-mix-config configs/mix/rain_mixed_val.yaml --loss custom --loss-config '{"charbonnier": {"weight": 1.0}}' \
  --crop-size 256 --batch-size 6 --accumulation-steps 1 --epochs 100 --mixed-precision --ema --compile \
  --output-dir ./runs/rain_mixed_nafnet

---

Training Curves

<p align="center"> <img src="training_curves.png" alt="Training and validation loss/PSNR curves for NAFNet (Mid)"/> </p>

---

Citation

@software{saksena2025clearview,
  author = {Saksena, Saumya Kumaar},
  title = {ClearView: Practical Image Deraining},
  year = {2025},
  url = {https://github.com/dronefreak/clearview}
}

Architecture and datasets this model builds on:

References

1. Fu et al. and others, Rain13K composite (Rain800/Rain100H/L/Rain14000/Rain12), standard MPRNet/Restormer training set.
2. Yang et al., Deep Joint Rain Detection and Removal from a Single Image, CVPR 2017 (Rain100H/L).
3. Zhang & Patel / Zhang, Sindagi & Patel (Test100 / Test1200).
4. Fu et al., Removing Rain from Single Images via a Deep Detail Network, CVPR 2017 (DDN-Data / Rain1400 / Test2800).
5. Wang et al., Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset, CVPR 2019 (SPA-Data).
6. Li et al., RealRain-1k, arXiv:2206.05514, 2022.
7. Li et al., Heavy Rain Image Restoration, CVPR 2019 (AllWeather rain+fog / Outdoor-Rain).
8. Chen, Chu, Zhang & Sun, Simple Baselines for Image Restoration, ECCV 2022, arXiv:2204.04676 (this model's architecture).

Full bibtex for each: main repo README.

---

Model Card Authors / Contact

Saumya Kumaar Saksena, GitHub Issues