vit-base-patch16-224-rtx4090-gated

hawada/vit-base-patch16-224-rtx4090-gated

This is a HawAda adapter for google/vit with gates trained for image classification on ImageNet100 with distillation from a pre-trained model https://huggingface.co/hawada/vit-base-patch16-224-in1k

This repository contains Gated student (with learned pruning gates). For Slim student (post-prune/export), visit https://huggingface.co/hawada/vit-base-patch16-224-rtx4090-slim.

Inference (Vision slim)

Training metadata

{
  "base_id": "google/vit-base-patch16-224",
  "variant": "gated-student",
  "description": "Full ViT backbone with learned soft gates for heads/FFN.",
  "repo_slim": "hawada/vit-base-patch16-224-rtx4090-slim"
}