Downloads · 30 days
840
2% of all-time downloads
flux-controlnet-canny
XLabs-AI/flux-controlnet-canny
flux-controlnet-canny is a text-to-image model from XLabs-AI. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as other.
All-time downloads
35.7K
Public
Repo size
7.4 GB
Likes
285
Public
Repo makeup
Click a slice to open those files.
.safetensors1.5 GB · 100%
At a glance
- Task
- Text-to-Image
- Library
- diffusers
- License
- other
- Access
- Public
- Created
- Aug 6, 2024
- Updated
- Aug 14, 2024
- SHA
- 0fafeb11
Base models
Model card
From the Hugging Face model README
This repository provides a checkpoint with trained ControlNet Canny model for FLUX.1-dev model by Black Forest Labs
ComfyUI
See our github for comfy ui workflows.
Training details
XLabs AI team is happy to publish fune-tuning Flux scripts, including:
- LoRA 🔥
- ControlNet 🔥
See our github for train script and train configs.
Training dataset
Dataset has the following format for the training process:
├── images/
│ ├── 1.png
│ ├── 1.json
│ ├── 2.png
│ ├── 2.json
│ ├── ...
A .json file contains "caption" field with a text prompt.
Inference
To test our checkpoints, use commands presented below.
python3 demo_controlnet_inference.py \
--checkpoint controlnet.safetensors \
--control_image "input_image.jpg" \
--prompt "a handsome viking man with white hair, cinematic, MM full HD"
python3 demo_controlnet_inference.py \
--checkpoint controlnet.safetensors \
--control_image "input_image.jpg" \
--prompt "a dark evil mysterius house with ghosts, cinematic, MM full HD"
License
controlnet.safetensors falls under the FLUX.1 [dev] Non-Commercial License<br/>
- Task
- Text-to-Image
- Library
- diffusers
- License
- other
- Languages
- en
- Created
- Aug 6, 2024
- Updated
- Aug 14, 2024