ComfyUI Workflow for VID2VID using AnimateDiff + ControlNet
needed custom node: RvTools (latest Version)
needs to be installed manually, manager registration is (still zZZzZzZzZ) pending...
if you don't see a preview in the samplers, open the manager, in Preview Method choose: Latent2RGB (fast)
Some small Tips:
apart from the fact that you should check the nodes for the correct models (checkpoint, controlnet, masking, face swap etc.), or add your own videos, image folders and audio files to the lists, its a good idea to check the other values of the nodes. when i run some tests and not visit a group again i often forget to reset the values. so when i e.g. skip 1000 frames in the background video and you run into issues because of that, its not a problem you have to report, its up to you to SEE this ;)
i would call this an advanced workflow because its kind of complex so there are a lot of areas to check. if you are new to comfyui its maybe not the best idea to start with something like this.
Description
Apart from the obvious changes to the layout, the following changes have been made:
slightly reworked the input area (input video)
added Load Masks, Load ControlNet Images/Videos (read the notes)
reworked the Masking Area
the masks are not saved as images with alpha channel anymore which speed up the process because adding the alpha channel to the images or converting them back to rgb is not needed anymore. but it is still possible to load images like this.
there is no Mask Apply group anymore, this group is splittet now into Masks Preview and Replace Background with Solid Color. the preview is using a blending to darken the background for a better preview of the mask while the other group is doin what the name says. the preview also allows you to disable the overlay to display the masks only.
all groups are able to save the output as image or video which can be switched on/off.
if you want to use the videos for further editing you should set the format to webm in the video combine nodes because it is lossless.
reworked the Face Swap Area
merged the ControlNet SD15 and XL Groups (read the notes)
i don't liked the scarface layout anymore maybe i stay with this one... who knows
fixed some issues in the masking senders (read the notes)
did i mentioned that you should read the notes? they are blueish and some are yellow, red and green xD