Downloads · 30 days
325
8% of all-time downloads
TheDenk/cogvideox-2b-controlnet-hed-v1
cogvideox-2b-controlnet-hed-v1 is a video-to-video model from TheDenk. Use it for the video-to-video task on the model card, and read the license before you ship it in a product. It is set up for diffusers. The card lists the license as apache-2.0.
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/VFtwrVimGF6g51PGQYwN.mp4"</video
Downloads · 30 days
325
8% of all-time downloads
All-time downloads
4.1K
Public
Parameters
458M
1.8 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors1.8 GB · 100%
From the Hugging Face model README
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/VFtwr_VimGF6g51PGQYwN.mp4"></video>
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/YaCSr74Iiw6nuqtT1Gtei.mp4"></video>
<a href="https://github.com/kijai/ComfyUI-CogVideoXWrapper">ComfyUI-CogVideoXWrapper </a> supports controlnet pipeline. See an <a href="https://github.com/kijai/ComfyUI-CogVideoXWrapper/blob/main/examples/cogvideox_1_0_2b_controlnet_02.json">example </a> file.
Clone repo
git clone https://github.com/TheDenk/cogvideox-controlnet.git
cd cogvideox-controlnet
Create venv
python -m venv venv
source venv/bin/activate
Install requirements
pip install -r requirements.txt
python -m inference.cli_demo \
--video_path "resources/car.mp4" \
--prompt "car is moving among mountains" \
--controlnet_type "hed" \
--base_model_path THUDM/CogVideoX-2b \
--controlnet_model_path TheDenk/cogvideox-2b-controlnet-hed-v1
python -m inference.gradio_web_demo \
--controlnet_type "hed" \
--base_model_path THUDM/CogVideoX-2b \
--controlnet_model_path TheDenk/cogvideox-2b-controlnet-hed-v1
Original code and models CogVideoX.