Downloads · 30 days
0
kanashi6/UniLIP
UniLIP is a machine learning model from kanashi6. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains the model (autoencoders) presented in the paper UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editing.
Downloads · 30 days
0
Access
Public
Updated Oct 10, 2025
Repo size
5.7 GB
Likes
2
Public
Click a slice to open those files.
.pth3.8 GB · 100%
From the Hugging Face model README
This repository contains the model (autoencoders) presented in the paper UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editing.
UniLIP proposes a unified, CLIP-based encoder featuring both rich semantics and fine-grained image details. Through a two-stage and self-distillation training for reconstruction, we empower CLIP to achieve excellent reconstruction results without compromising its original understanding abilities. Leveraging this powerful unified representation, UniLIP excels across understanding, generation, and editing tasks.
For more details, please refer to the original paper and the GitHub repository:
Paper: https://www.arxiv.org/abs/2507.23278
GitHub: https://github.com/nnnth/UniLIP