This workflow makes abstract animations using images and pre-generated depth maps (that are already black and white and don't require preprocessing).
Then these videos can be made audio-reactive by feeding them into the audioreactive setup in TouchDesigner, using the included a sample .tox. This uses automatic beat detection to drive the speed of the palyback of the. The free non-commercial version of TouchDesigner is sufficient for this workflow (only limitation is a maximum resolution of 1280x1280)
I have also included 37 black and white loops to play with! (QuickTime 7 might be needed to play back these mov's)
Description
Initial commit
FAQ
Comments (22)
I was just wondering how to do this and you came along with this little kit put together. Thanks !
He's going to be going over the entire workflow on the Civitai Twitch stream today at 3pm PST!
@jboogx_creative is there replays?
what is this file audioreactiveTime_basic.toe?
It is a TouchDesigner workflow file for the audio reactivity part
The image Dir Iterator shows an error Error occurred when executing ImageDirIterator: [WinError 267] The directory name is invalid: 'D:\
Even though I copied the file path
Can create depth maps with Depth map Lora - SD1.5, feed it into touchdesigner and create a audioreactive depth map :)
if you’ve never used touchdesigner before like me I suggest changing the play mode of audiofilein1 to “Locked to Timeline” instead of “Sequential” and changing the End and REnd values which will let you scrub through the audio like other programs
you are a god
Hi, thanks for this great work! I have a question, what is that controlnet_checkpoint.ckpt? where can I download it? Tried to google it but the result seems irrelevant
Hey man thank you for the great work!!
ı got from "Error occurred when executing VidDirIterator:" what should ı put there
Wow good workflow!
Hello, what is clip vision model used?
I don't understand anything from this. I've been fixing with this shit for 4 hours now. I'm getting 2 video output, one based on input images and one based on "your masks".
And Touch designer doesn't do shit, besides distorting the images on imaginary sound. Because there's no way to get the damn thing to play any actual sound 😠
absolutely made my day - and probably next weeks!!
so great and packed with useful info. as a beginner I needed a full day to go through and solve some issues...learning curve, in the end it works! dont give up ;) Massive thanks @cerspence for sharing!!!
I feel lost, are you planning to make a tutorial?
Maybe Im just a complete moron, butt I couldnt really get that far in any of the tutorial about this setup on Youtube. Would it be possible to reference the tools in which you use in each module? I would search the directories in the dropdown boxes for certain things and it either wouldnt show what was being selected or I would end up scouring civitai anf google to find the proper file and allocate it to the folder that it was supposed to be referencing.
I don't think this is working anymore. It would be awesome if we could get an updated workflow.
how to fix this??
ImageDirIterator
No valid image files found in directory 'image references folder path' with patterns '1'.
delete it