Animatediff workflow i made using AlignYourSteps schedulers, it's still a bit experimental. Should be wayyyyy faster than normal and can be used with normal checkpoints.
txt2vid, img2vid, vid2vid, ipadapter, cnets for pose, depth, softedge, canny.
Not a beginner friendly workflow!
Preparations:
Read the yellow note-nodes
Download all required models and loras
reselect all models, loras, VAE etc to make sure they are all correctly selected (use whatever VAE you want)
Note that the NEGATIVE prompt box is minimized by default under the POSITIVE one
On the far right, make sure to check the whole save node cluster and follow instructions
get a motion lora if you want to use one
Check all the switches and what they do
Recommended checkpoints: AstrAnime_V6, Photon (both behave well with animatediff), but use whatever.
https://github.com/guoyww/AnimateDiff has links to download v3_adapter_sd_v15.ckpt and v3_sd15_mm.ckpt.ckpt
https://github.com/cubiq/ComfyUI_IPAdapter_plus?tab=readme-ov-file has links to download the IPAdater models needed
https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main has the control_v11f1e_sd15 models for controlnet
Description
FAQ
Comments (7)
Yea, it can get a bit complicated :D
cool thanks!!, how do I increase the duration for the animation?
batch size
can you please screen shot me where is batch size?
@Astraali CR SD1.5 Aspect Ratio batch_size?
@rladnsdydk29502791 yes the cr aspect ratio