Downloads · 30 days
15
9% of all-time downloads
xwei00/DRRho-CLIP-ViT-B-16-DFN-192M-Ref-ViT-B-32
DRRho-CLIP-ViT-B-16-DFN-192M-Ref-ViT-B-32 is a machine learning model from xwei00. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for open_clip. The card lists the license as mit.
<h1 align="center"Model Steering: Learning with a Reference Model Improves Generalization Bounds and Scaling Laws</h1
Downloads · 30 days
15
9% of all-time downloads
All-time downloads
172
Public
Repo size
1.2 GB
Likes
0
Public
Click a slice to open those files.
.bin599 MB · 50%
From the Hugging Face model README
Paper link: arXiv
Code & more: GitHub
This repository hosts a ViT-B/16 CLIP model trained using DRRho-CLIP with OpenAI ViT-B/32 CLIP model as reference. The training dataset is DFN-192M and the number of samples seen is 1.28B. Commands and code to reproduce are provided in the GitHub repository, and more details can be found in the paper.