Downloads · 30 days
286
10% of all-time downloads
cogvideox-2b-controlnet-canny-v1
TheDenk/cogvideox-2b-controlnet-canny-v1
cogvideox-2b-controlnet-canny-v1 is a video-to-video model from TheDenk. Use it for the video-to-video task on the model card, and read the license before you ship it in a product. It is set up for diffusers. The card lists the license as apache-2.0.
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/TIHMy6p3IzjmeP2V244hc.mp4"</video
All-time downloads
3K
Public
Parameters
458M
1.8 GB on disk
Likes
16
Public
Repo makeup
Click a slice to open those files.
.safetensors1.8 GB · 100%
At a glance
- Task
- Video-to-Video
- Library
- diffusers
- License
- apache-2.0
- Access
- Public
- Created
- Oct 7, 2024
- Updated
- Dec 2, 2024
- SHA
- e65001a4
Model card
From the Hugging Face model README
CogvideoX Controlnet Extention
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/TIHMy6p3IzjmeP2V244hc.mp4"></video>
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/0B_PWKEDmLyL_V1p1njc2.mp4"></video>
ComfyUI
<a href="https://github.com/kijai/ComfyUI-CogVideoXWrapper">ComfyUI-CogVideoXWrapper </a> supports controlnet pipeline. See an <a href="https://github.com/kijai/ComfyUI-CogVideoXWrapper/blob/main/examples/cogvideox_1_0_2b_controlnet_02.json">example </a> file.
How to
Clone repo
git clone https://github.com/TheDenk/cogvideox-controlnet.git
cd cogvideox-controlnet
Create venv
python -m venv venv
source venv/bin/activate
Install requirements
pip install -r requirements.txt
Inference examples
Inference with cli
python -m inference.cli_demo \
--video_path "resources/car.mp4" \
--prompt "car is moving among mountains" \
--controlnet_type "canny" \
--base_model_path THUDM/CogVideoX-2b \
--controlnet_model_path TheDenk/cogvideox-2b-controlnet-canny-v1
Inference with Gradio
python -m inference.gradio_web_demo \
--controlnet_type "canny" \
--base_model_path THUDM/CogVideoX-2b \
--controlnet_model_path TheDenk/cogvideox-2b-controlnet-canny-v1
Acknowledgements
Original code and models CogVideoX.
Contacts
<p>Issues should be raised directly in the repository. For professional support and recommendations please <a>[email protected]</a>.</p>- Task
- Video-to-Video
- Library
- diffusers
- License
- apache-2.0
- Languages
- en
- Created
- Oct 7, 2024
- Updated
- Dec 2, 2024