Downloads · 30 days
60
2% of all-time downloads
Norod78/sd15-caricature-portraits-blip-captions
sd15-caricature-portraits-blip-captions is a text-to-image model from Norod78. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as creativeml-openrail-m.
Stable Diffusion v1.5 fine tuned on the 2D Caricature Dataset from 3D-CariGAN cropped to 512x512 and blip captioned
Downloads · 30 days
60
2% of all-time downloads
All-time downloads
3.7K
Public
Repo size
6 GB
Likes
7
Public
Click a slice to open those files.
.bin3.9 GB · 64%
From the Hugging Face model README
Stable Diffusion v1.5 fine tuned on the 2D Caricature Dataset from 3D-CariGAN cropped to 512x512 and blip captioned
If you want more details on how to generate your own blip cpationed dataset see this colab
Training was done using this Hugging-Face's text to image training script
Put in a text prompt and generate caricatures
The main folder contains a .safetensors file to be put in stable-diffusion-webui "stable-diffusion-webui/models/Stable-diffusion" folder and used to generate images

Finetuned for 10,000 iterations upon runwayml/stable-diffusion-v1-5 on BLIP captioned portraits portraits using 1xA5000 GPU on my home desktop computer
Trained by @Norod78
@article{ye2021caricature,
author = {Ye, Zipeng and Xia, Mengfei and Sun, Yanan and Yi, Ran and Yu, Minjing and Zhang, Juyong and Lai, Yu-Kun and Liu, Yong-Jin},
title = {3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Normal Face Photos},
journal = {IEEE Transactions on Visualization and Computer Graphics},
year = {2021},
doi={10.1109/TVCG.2021.3126659},
}
