So now that @ryanontheinside updated his node suite, i took the time to finally organize my huge AudioReact WF i've been workin on for myself and for my uni thesis for the past months.
I've used a slightly modified version in this video, which is I2V and V2V and was before implementing GWTF https://www.youtube.com/watch?v=MVQ-8Z813Jk
You need that specific version of both @ryanontheinside and @Yvann nodes.
To use it you have to provide A video and an audio, same lenght. Specify the output dimensions. If you encounter in some error due to "latent size mismatch" just change the output res to the standard ones accepted by Flux T
he workflow uses GoWithTheFlow to extract motion from any video. SparseRGB is also used to keep consistency from the input images
Thanks a lot to everyone who helped me troubleshoot errors and fix issues
Thanks a lot to the Banodoco Server https://discord.gg/ETTUrtCUy8