Downloads · 30 days
0
colpali-v1.2-merged-state_dict
vidore/colpali-v1.2-merged-state_dict
colpali-v1.2-merged-state_dict is a machine learning model from vidore. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for colpali. The card lists the license as gemma.
[!WARNING] WARNING: This repository should only be used to convert the original ColPali weights to the Hf version of Colpali.
Access
Public
Updated Oct 30, 2024
Repo size
5.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth5.8 GB · 100%
At a glance
- Library
- colpali
- License
- gemma
- Access
- Public
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024
- SHA
- e59ec774
Base models
Datasets
Model card
From the Hugging Face model README
ColPali: Visual Retriever based on PaliGemma-3B with ColBERT strategy (merged, state_dict only)
[!WARNING] WARNING: This repository should only be used to convert the original ColPali weights to the Hf version of Colpali.
State dict was exported from vidore/colpali-v1.2-merged. The model was loaded using the following code:
# Get the device
device = "mps"
# Define dtype
dtype_precision = torch.bfloat16
# Load the original model and state_dict
model = (
cast(
ColPali,
ColPali.from_pretrained(
"vidore/colpali-v1.2-merged",
torch_dtype=dtype_precision,
device_map=device,
),
)
.to(dtype_precision)
.eval()
)
- Library
- colpali
- License
- gemma
- Languages
- en
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024