Downloads · 30 days
26
0% of all-time downloads
visheratin/nllb-clip-large-oc
nllb-clip-large-oc is a zero-shot image classification model from visheratin. Use it for the zero-shot image classification task on the model card, and read the license before you ship it in a product. It is set up for open_clip. The card lists the license as cc-by-nc-4.0.
NLLB-CLIP is a model that combines a text encoder from the NLLB model and an image encoder from the LAION CLIP. This allows us to extend the model capabilities to 201 languages of the Flores-200. NLLB-CLIP sets state-…
Downloads · 30 days
26
0% of all-time downloads
All-time downloads
45.1K
Public
Repo size
5.6 GB
Likes
3
Public
Click a slice to open those files.
.bin5.6 GB · 100%
From the Hugging Face model README
NLLB-CLIP is a model that combines a text encoder from the NLLB model and an image encoder from the LAION CLIP. This allows us to extend the model capabilities to 201 languages of the Flores-200. NLLB-CLIP sets state-of-the-art on the Crossmodal-3600 dataset by performing very well on low-resource languages. You can find more details about the model in the paper.
I thank ML Collective for providing Google Cloud compute resources to train the OpenCLIP-compatible version of NLLB-CLIP.