Downloads · 30 days
2
6% of all-time downloads
lukahh/cultureclip_lora_0315_100k_32_03_07
cultureclip_lora_0315_100k_32_03_07 is a machine learning model from lukahh. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a CLIP model fine-tuned with LoRA for cultural understanding and image-text matching. The LoRA weights have been merged into the base model.
Downloads · 30 days
2
6% of all-time downloads
All-time downloads
34
Public
Parameters
151M
607 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors606 MB · 99%
From the Hugging Face model README
This is a CLIP model fine-tuned with LoRA for cultural understanding and image-text matching. The LoRA weights have been merged into the base model.
from transformers import CLIPModel, CLIPProcessor
# Load model and processor
model = CLIPModel.from_pretrained("lukahh/cultureclip_lora_0315_100k_32_03_07")
processor = CLIPProcessor.from_pretrained("openai/clip-vit-base-patch32") # Use base model's processor
# Process text and images
inputs = processor(
text=["a photo of a cat", "a photo of a dog"],
images=image,
return_tensors="pt",
padding=True
)
# Get outputs
outputs = model(**inputs)
This model was fine-tuned using LoRA and then merged back into the base model. The LoRA approach enables efficient adaptation of the CLIP model while maintaining its core capabilities.