ViT-ISR-Tiny-LSDIR

ViT-ISR-Tiny: Vision Transformer for ×4 Image Super-Resolution

A Vision Transformer for ×4 image super-resolution — built entirely from scratch in PyTorch, trained on 76,716 real-world images from the LSDIR benchmark, a tiny model with less than million parameters

👉 Try the Live Demo

---

What it does

Takes a low-resolution image and reconstructs a ×4 higher-resolution version using global self-attention — capturing long-range spatial relationships across the entire image rather than just local neighborhoods like CNNs do.

---

Architecture

The pipeline: patch embed → transformer blocks → reshape → PixelShuffle upsample → RGB output.

Why pre-norm: LayerNorm before each sub-layer keeps the residual path clean, stabilizing training in deep stacks.

Why PixelShuffle: Learned upsampling — the model decides what to put in new pixels by redistributing channel information into space, rather than stretching with interpolation.

Why patch size 2: Finer tokens preserve more spatial detail for reconstruction. Larger patches are cheaper but lose the high-frequency information SR depends on.

---

Training

Test PSNR: 23.30 dB — evaluated on the held-out test split (never seen during training or checkpoint selection).

---

Usage

from huggingface_hub import hf_hub_download
import torch

weights_path = hf_hub_download("Sathya77/ViT-ISR-Tiny-LSDIR", "sr_best.pt")
checkpoint = torch.load(weights_path, map_location="cpu")

model = ImageSRTransformer()   # from model_architecture.py
model.load_state_dict(checkpoint["model_state_dict"])
model.eval()

---

Files