Downloads · 30 days
0
CLIPtion
pharmapsychotic/CLIPtion
CLIPtion is a machine learning model from pharmapsychotic. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Access
Public
Updated Dec 23, 2024
Repo size
117 MB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors117 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Dec 21, 2024
- Updated
- Dec 23, 2024
- SHA
- 454f7864
Model card
From the Hugging Face model README
CLIPtion is a fast and small captioning extension to OpenAI CLIP ViT-L/14. You already have ViT-L loaded when using using Stable Diffusion, SDXL, SD3, FLUX, etc and with just an extra 100MB memory you can include caption/prompt generation in your workflows!
I made this for fun and am sure bigger dedicated caption models and VLM's will give you more accurate captioning, but this guy is tiny, fast, reuses what you already have loaded, and has options to give better CLIP alignment so give it a try if you like!
Big thanks to Ben Egan, SilentAntagonist, Alex Redden, XWAVE, and Jacky-hate whose synthetic caption datasets I included in the training.
Use this model in ComfyUI with the comfy-cliption extension!
- License
- mit
- Created
- Dec 21, 2024
- Updated
- Dec 23, 2024