Downloads · 30 days
17
19% of all-time downloads
Nayana-cognitivelab/NayanaEmbed-ColGemma3-Merge-Colbert-base-nayana-linear
NayanaEmbed-ColGemma3-Merge-Colbert-base-nayana-linear is a image-text-to-text model from Nayana-cognitivelab. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as gemma.
This model is a merged version of multiple ColGemma3 models using the linear merging technique.
Downloads · 30 days
17
19% of all-time downloads
All-time downloads
88
Public
Parameters
4.3B
17.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.6 GB · 100%
From the Hugging Face model README
This model is a merged version of multiple ColGemma3 models using the linear merging technique.
Linear interpolation: Weighted average of model parameters.
ColGemma3 is a vision-language model for late interaction retrieval:
from colpali_engine.models.gemma3.colgemma3 import ColGemma3, ColGemmaProcessor3
from PIL import Image
import torch
# Load model and processor
model = ColGemma3.from_pretrained("Nayana-cognitivelab/NayanaEmbed-ColGemma3-Merge-Colbert-base-nayana-linear", torch_dtype=torch.bfloat16, device_map="auto")
processor = ColGemmaProcessor3.from_pretrained("Nayana-cognitivelab/NayanaEmbed-ColGemma3-Merge-Colbert-base-nayana-linear")
# Process images
images = [Image.open("document.png")]
batch_images = processor.process_images(images).to(model.device)
# Process queries
queries = ["What is this document about?"]
batch_queries = processor.process_queries(queries).to(model.device)
# Generate embeddings
with torch.no_grad():
img_embeddings = model(**batch_images)
query_embeddings = model(**batch_queries)
# Compute similarity scores
scores = processor.score([query_embeddings[0]], [img_embeddings[0]])
If you use this model, please cite the original ColGemma3 work and the source models.
This model was automatically merged using Modal infrastructure.