Downloads · 30 days
15
3% of all-time downloads
LEAF-CLIP/OpenCLIP-ViT-H-rho50-k1-constrained-FARE2
OpenCLIP-ViT-H-rho50-k1-constrained-FARE2 is a feature extraction model from LEAF-CLIP. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
[[Paper]](https://www.arxiv.org/abs/2506.03355) [[Code]](https://github.com/LIONS-EPFL/LEAF)
Downloads · 30 days
15
3% of all-time downloads
All-time downloads
509
Public
Parameters
986M
3.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.9 GB · 100%
From the Hugging Face model README
Model Initialized from laion/CLIP-ViT-H-14-laion2B-s32B-b79K. The image encoder is finetuned with FARE at $\epsilon=2/255$. The text encoder is finetuned with LEAF at $k=1$ with $\rho=50$ and semantic constraints.
To load this model use:
from transformers import CLIPProcessor, CLIPModel
model_name = "LEAF-CLIP/OpenCLIP-ViT-H-rho50-k1-constrained-FARE2"
processor_name = "laion/CLIP-ViT-H-14-laion2B-s32B-b79K"
model = CLIPModel.from_pretrained(model_name)
processor = CLIPProcessor.from_pretrained(processor_name)