Downloads · 30 days
0
clip-prefix-caption-conceptual
Hamza66628/clip-prefix-caption-conceptual
clip-prefix-caption-conceptual is a machine learning model from Hamza66628. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Image captioning model based on CLIP and GPT-2, trained on Conceptual Captions dataset.
Access
Public
Updated Dec 2, 2025
Repo size
636 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt636 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Dec 2, 2025
- Updated
- Dec 2, 2025
- SHA
- 36a50e8f
Model card
From the Hugging Face model README
CLIP Prefix Caption - Conceptual Captions Model
Image captioning model based on CLIP and GPT-2, trained on Conceptual Captions dataset.
Model Details
- Model Type: CLIP Prefix Captioning
- Architecture: CLIP Vision Encoder + MLP Mapping + GPT-2 Text Decoder
- Dataset: Conceptual Captions
- Prefix Length: 10 tokens
- CLIP Model: ViT-B/32
- GPT-2 Model: gpt2
Usage
See the test notebook for usage examples.
Files
model.pt: Model checkpoint (state_dict)
Citation
If you use this model, please cite:
@article{mokady2021clipcap,
title={ClipCap: CLIP Prefix for Image Captioning},
author={Mokady, Ron and Hertz, Amir and Bermano, Amit H},
journal={arXiv preprint arXiv:2111.09734},
year={2021}
}
- License
- mit
- Created
- Dec 2, 2025
- Updated
- Dec 2, 2025