Description
Deforum is an addon for Stable Diffusion. It allows seed travelling, and was one of the first ways to generate animated content with Stable Diffusion. Which i have used for quite a while before i switched from Automatic1111 to ComfUI and AnimateDiff.
I know i'm a bit late to the party here, by picking up this old technique. But i still find this method highly fascinating. And information about it is hard to find nowadays. Since everybody, including me, has now migrated to the new video models. And this is one way to archive my knowledge also for myself.
In the zipfile you will find four example setting files that i have used to generate my music videos. There is also an explanation video at Youtube available that gives you a kickstart.
Howto
Load one of the example settings files from the zipfile. Adjust prompt. Choose model. Maybe add an initial image. Generate.
Generation time
Heavily depends of the settings and the size. Multiply the time to generate a single frame with the number of frames.
Requirements
The videos made with these workflows were generated with 8 gb vram back in the days. I heard rumours that it even worked with 6 gb. It is an old technique from the early days.
You need SD WebUI from Automatic1111 or ForgeUI. I have used the Automatic111 solution. ForgeUI did not exist back in the days.
I do NOT recommend to even try out the addon for ComfyUI. I did. And it killed my installation by messing around with the torch version. I had to start from scratch.
You need FFMpeg installed. https://www.ffmpeg.org/
And of course you need the Deforum addon, which is located here: I am not sure if this version of the addon also works in ForgeUI, but should. ForgeUI is a fork of the Automatic1111 version: https://github.com/deforum-art/sd-webui-deforum
Laters - Arunderan