Downloads · 30 days
0
jfischoff/diff_loss_mid_down_blocks
diff_loss_mid_down_blocks is a machine learning model from jfischoff. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is model is a demonstration of an alternative loss function for video training, diffloss. Unlike the typical frame by frame reconstruction loss, diffloss ensures the frame by frame differences of the target and p…
Downloads · 30 days
0
Access
Public
Updated Nov 13, 2023
Repo size
1.8 GB
Likes
14
Public
Click a slice to open those files.
.ckpt1.8 GB · 100%
From the Hugging Face model README
diff_loss_mid_down_blocksThis is model is a demonstration of an alternative loss function for video training, diff_loss. Unlike the typical frame by frame reconstruction loss, diff_loss ensures the frame by frame differences of the target and predicted noise are the same.
This model is a fine-tuned version of the AD 1.5 v2 model. It was trainined for 3600 steps with LR of 9e-7 and a batch size of 16. Only the down and mid blocks were trained.
For more details about this model see the associated blog post here