Downloads · 30 days
45
2% of all-time downloads
juliensimon/stable-diffusion-v1-5-pokemon-lora
stable-diffusion-v1-5-pokemon-lora is a text-to-image model from juliensimon. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as creativeml-openrail-m.
LoRA adaptation weights for Stable Diffusion v1.5, fine-tuned on the Pokemon BLIP Captions dataset (833 samples) to generate Pokemon-style images from text prompts.
Downloads · 30 days
45
2% of all-time downloads
All-time downloads
1.8K
Public
Repo size
169 MB
Likes
4
Public
Click a slice to open those files.
.0116 MB · 65%
From the Hugging Face model README
LoRA adaptation weights for Stable Diffusion v1.5, fine-tuned on the Pokemon BLIP Captions dataset (833 samples) to generate Pokemon-style images from text prompts.
Video walkthrough: Fine-tune Stable Diffusion with LoRA for as low as $1
| Detail | Value |
|---|---|
| Method | 4-bit QLoRA following the official LoRA blog post |
| Hardware | Amazon EC2 g4dn.xlarge (1x NVIDIA T4 GPU) |
| Environment | AWS Deep Learning AMI for PyTorch |
| Training time | ~6 hours |
| Cost | ~$3 on-demand / ~$1 with EC2 Spot Instances |
from diffusers import StableDiffusionPipeline
import torch
pipe = StableDiffusionPipeline.from_pretrained(
"runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16
)
pipe.unet.load_attn_procs("juliensimon/stable-diffusion-v1-5-pokemon-lora")
pipe.to("cuda")
image = pipe("a pokemon with blue fire wings").images[0]