Uses the Batch Value Schedule to drive Multival Dynamic (AnimateDiff Temporal Self-Attention Temperature).
Use framesync.xyz to generate keyframes from your audio file, and paste those into the Batch Value Schedule. Make sure the number of frames generated is the same as the number of keyframes you get from framesync, and make sure the output framerate of the saved video is the same as the sample rate in framesync
Very simple audioreactivity
Description
FAQ
Comments (3)
Great stuff, I had to change a few things to make it work as I entended, but this was very helpfull. Particularly I had to change a lot of settings on the framsync site to get keyframes as high or as low as they should be, especially to use the same concept at the AnimateDiff effect_multival input.
Additionally I used AnyNode to manipulate the key frames even more, normalizing the curve in order to get more consistent animation, I'm thinking about going further this rabbit-hole and making some sort of pre processing of the audio key frames inside Comfy. If I get things working properly I could add the content here If you want
that would be awesome!
It's good if the authors indicate the names of the models, download paths and installation location.