Downloads · 30 days
181
0% of all-time downloads
nllb-clip-base-oc
visheratin/nllb-clip-base-oc
nllb-clip-base-oc is a zero-shot image classification model from visheratin. Use it for the zero-shot image classification task on the model card, and read the license before you ship it in a product. It is set up for open_clip. The card lists the license as cc-by-nc-4.0.
NLLB-CLIP is a model that combines a text encoder from the NLLB model and an image encoder from the standard CLIP. This allows us to extend the model capabilities to 201 languages of the Flores-200. NLLB-CLIP sets sta…
All-time downloads
37.6K
Public
Repo size
2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin2 GB · 99%
At a glance
- Task
- Zero-Shot Image Classification
- Library
- open_clip
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Oct 7, 2023
- Updated
- Oct 24, 2023
- SHA
- f16398ba
Datasets
Model card
From the Hugging Face model README
Model Summary
NLLB-CLIP is a model that combines a text encoder from the NLLB model and an image encoder from the standard CLIP. This allows us to extend the model capabilities to 201 languages of the Flores-200. NLLB-CLIP sets state-of-the-art on the Crossmodal-3600 dataset by performing very well on low-resource languages. You can find more details about the model in the paper.
Acknowledgements
I thank ML Collective for providing Google Cloud compute resources to train the OpenCLIP-compatible version of NLLB-CLIP.
- Task
- Zero-Shot Image Classification
- Library
- open_clip
- License
- cc-by-nc-4.0
- Created
- Oct 7, 2023
- Updated
- Oct 24, 2023