Downloads · 30 days
35
2% of all-time downloads
PSALM
EnmingZhang/PSALM
PSALM is a machine learning model from EnmingZhang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
A powerful extension of the Large Multi-modal Model for generic (panoptic, instance, semantic) segmentation, referring segmentation and interactivate segmentation. Support joint training across multiple segmentation t…
All-time downloads
1.8K
Public
Parameters
1.6B
6.4 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors6.4 GB · 100%
Parameter types
How the weights are stored.
F321.6B · 100%
Model card
From the Hugging Face model README
PSALM: Pixelwise SegmentAtion with Large Multi-Modal Model
Features
- A powerful extension of the Large Multi-modal Model for generic (panoptic, instance, semantic) segmentation, referring segmentation and interactivate segmentation.
- Support joint training across multiple segmentation tasks and visual-language tasks.
- Demonstrates zero-shot capabilities on unseen task, such as open-vocabulary segmentation, generalizaed referring segmentation, and video object segmentation.
Note
You need to change mm_vision_tower to your mask2former checkpoint path.
- Library
- transformers
- Type
- llava_phi
- License
- apache-2.0
- Created
- Mar 17, 2024
- Updated
- Mar 17, 2024