Downloads · 30 days
18
29% of all-time downloads
clip-datacomp-12m-16
Leonardo6/clip-datacomp-12m-16
clip-datacomp-12m-16 is a machine learning model from Leonardo6. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is a CLIP (Contrastive Language-Image Pre-training) model trained on DataComp-12M dataset.
All-time downloads
63
Public
Repo size
2.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin343 MB · 100%
At a glance
- License
- mit
- Model type
- clip_vision_model
- Access
- Public
- Created
- Jan 18, 2025
- Updated
- Feb 8, 2025
- SHA
- e05de74c
Model card
From the Hugging Face model README
CLIP ViT-B/16 Model
This is a CLIP (Contrastive Language-Image Pre-training) model trained on DataComp-12M dataset.
Training Details
- Architecture: ViT-B/16
- Dataset: DataComp-12M
- Batch size per GPU: 512
- Number of GPUs: 4
- Total epochs: 20
- Precision: amp
- Total training samples: 203,020,740
Training Command
torchrun --nproc_per_node 4 -m open_clip_train.main \
--save-frequency 1 \
--train-data '/pasteur2/u/yuhuiz/yiming/datacomp_12m/processed_dataset/{00000000..00001023}.tar' \
--train-num-samples $((203020740 / 20)) \
--local-loss \
--gather-with-grad \
--warmup 1000 \
--dataset-type webdataset \
--batch-size 512 \
--epochs 20 \
--model ViT-B-16 \
--precision amp \
--seed 0 \
--workers 4
- Type
- clip_vision_model
- License
- mit
- Languages
- en
- Created
- Jan 18, 2025
- Updated
- Feb 8, 2025