Downloads · 30 days
38
22% of all-time downloads
videomt-dinov2-large-vspw
tue-mps/videomt-dinov2-large-vspw
videomt-dinov2-large-vspw is a image segmentation model from tue-mps. Use it for the image segmentation task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This repository contains the Hugging Face Transformers conversion of the official VidEoMT checkpoint vspwvitlarge95.064.9.pth from tue-mps/VidEoMT.
All-time downloads
172
Public
Parameters
323M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 100%
At a glance
- Task
- Image Segmentation
- Library
- transformers
- Model type
- videomt
- Access
- Public
- Created
- Mar 27, 2026
- Updated
- Mar 27, 2026
- SHA
- 9ef7c765
Model card
From the Hugging Face model README
VidEoMT-L on VSPW
This repository contains the Hugging Face Transformers conversion of the official VidEoMT checkpoint
vspw_vit_large_95.0_64.9.pth from tue-mps/VidEoMT.
Model details
- Architecture: VidEoMT with a DINOv2 ViT-L/14 with 4 register tokens backbone
- Task: video semantic segmentation
- Dataset: VSPW
- Input resolution: 1280 x 1280
- Number of frames: 2
- Paper: Your ViT is Secretly Also a Video Segmentation Model
Reported metrics
| Metric | Value |
|---|---|
| mVC_16 | 95.0 |
| mIoU | 64.9 |
| FPS | 73 |
The metrics above are the numbers reported by the authors in the official model zoo.
Usage
from transformers import AutoModelForUniversalSegmentation, AutoVideoProcessor
model_id = "tue-mps/videomt-dinov2-large-vspw"
processor = AutoVideoProcessor.from_pretrained(model_id)
model = AutoModelForUniversalSegmentation.from_pretrained(model_id)
Use processor.post_process_instance_segmentation,
processor.post_process_panoptic_segmentation, or
processor.post_process_semantic_segmentation depending on the target task.
- Task
- Image Segmentation
- Library
- transformers
- Type
- videomt
- Created
- Mar 27, 2026
- Updated
- Mar 27, 2026