Downloads · 30 days
0
ccld_wa
huggan/ccld_wa
ccld_wa is a machine learning model from huggan. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
For the huggan event we decided to fine-tune a cloob-conditioned latent diffusion model. Training largely followed the guidelines in https://github.com/JD-P/cloob-latent-diffusion The (lightly modified) training scrip…
Access
Public
Updated Apr 7, 2022
Repo size
5.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.ckpt5.1 GB · 100%
At a glance
- Access
- Public
- Created
- Apr 7, 2022
- Updated
- Apr 7, 2022
- SHA
- 1e341349
Model card
From the Hugging Face model README
For the #huggan event we decided to fine-tune a cloob-conditioned latent diffusion model. Training largely followed the guidelines in https://github.com/JD-P/cloob-latent-diffusion The (lightly modified) training script is included in this model repo, but I'd recommend starting in the github repository linked above. The model was fine-tuned on Wikiart (huggan/WikiArt) for ~12 hours on 2 A6000 GPUs kindly provided by Paperspace. The large files in this repository are
- df_model.ckpt: The latent diffusion model
- ae_model.ckpt: The autoencoder in whose latent space we operate
- ae_model.yaml: the config file needed to load said autoencoder
The final component is CLOOB, but the code for sampling will include downloading the right pretrained CLOOB model since we didn't modify that bit.
More info coming soon.
For now if you really want to try it, this colab (https://colab.research.google.com/drive/1HPu6tz44brMnKOU4G6Luhy1_iMgDl1fw#scrollTo=2s0I4RksiHtA) will download the models and set up a gradio interface for it.
- Created
- Apr 7, 2022
- Updated
- Apr 7, 2022