Downloads · 30 days
0
Ctrl-Adapter
hanlincs/Ctrl-Adapter
Ctrl-Adapter is a machine learning model from hanlincs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for diffusers. The card lists the license as mit.
CTRL-Adapter is an efficient and versatile framework for adding diverse spatial controls to any image or video diffusion model. It supports a variety of useful applications, including video control, video control with…
Access
Public
Updated May 2, 2024
Repo size
30.2 GB
Likes
25
Public
Repo makeup
Click a slice to open those files.
.safetensors23.2 GB · 100%
At a glance
- Library
- diffusers
- License
- mit
- Access
- Public
- Created
- Apr 15, 2024
- Updated
- May 2, 2024
- SHA
- 258e1cc4
Model card
From the Hugging Face model README
This repo contains the pretrained checkpoints for Ctrl-Adapter
CTRL-Adapter is an efficient and versatile framework for adding diverse spatial controls to any image or video diffusion model. It supports a variety of useful applications, including video control, video control with multiple conditions, video control with sparse frame conditions, image control, zero-shot transfer to unseen conditions, and video editing.
See also: https://github.com/HL-hanlin/Ctrl-Adapter
<br> <img width="800" src="assets/teaser.gif"/> <br>Description of Model Checkpoints
SDXL
Depth map
- Ctrl-Adapter/sdxl_depth/diffusion_pytorch_model.safetensors
Canny edge
- Ctrl-Adapter/sdxl_canny/diffusion_pytorch_model.safetensors
I2VGen-XL
Depth map
- Ctrl-Adapter/i2vgenxl_depth/diffusion_pytorch_model.safetensors
Canny edge
- Ctrl-Adapter/i2vgenxl_canny/diffusion_pytorch_model.safetensors
Soft edge
- Ctrl-Adapter/i2vgenxl_softedge/diffusion_pytorch_model.safetensors
Sparse control with user scribbles
- Ctrl-Adapter/i2vgenxl_scribble_sparse/diffusion_pytorch_model.safetensors
Multi-condition control trained on depth map, canny edge, normal map, soft edge, segmentation, line art, and openpose
- Ctrl-Adapter/i2vgenxl_multi_control_adapter/diffusion_pytorch_model.safetensors
- Ctrl-Adapter/i2vgenxl_multi_control_router/diffusion_pytorch_model.safetensors
SVD
Depth map
- Ctrl-Adapter/svd_depth/diffusion_pytorch_model.safetensors
Canny edge
- Ctrl-Adapter/svd_canny/diffusion_pytorch_model.safetensors
Soft edge
- Ctrl-Adapter/svd_softedge/diffusion_pytorch_model.safetensors
- Library
- diffusers
- License
- mit
- Created
- Apr 15, 2024
- Updated
- May 2, 2024