Description

This is an Animatediff 3 workflow with a start and an end image. This is done across Sparse Control. And this workflow is made of two steps. First you create a preview video with 8 frames per seconds and in the usual fitting size for Animatediff. And then you upscale it with the Supermegabadassupscaler workflow.

The result is of course not as good as from the newer AI video models. And you now need to do some further work in your video editing software. But for Animatediff it is nevertheless impressing.

Howto

Load a start and end image. Adjust prompt, size and length. Produce a preview video. Upscale this preview video in the Supermegabadassupscaler workflow to the final result and frame rate.

Time

The preview video in the length of 4 seconds and a size of 560 x 320 took around two minutes. And upscaling then took another two and a half minutes to a size of 1120 x 640.

Requirements

The workflows requires at least 12 gb vram. It uses the UltimateUpscale SD node, which simply runs out of memory most of the times with a card with just 8 gb vram. I was never able to use it with my old card.