This is an evolution of my v3 workflow. Cut down and put together for ease of use.
This workflow utilizes and requires an Alpha Mask that matches your video input to work properly. It will take the mask, resize is (shoutout to @Kijai for helping me get passed the initial CUDA errors), and invert it.
How you go about getting that AlphaMask is entirely up to you. I personally like rotoscoping manually in Adobe After Effects for precision.
The first two IPAdapter images will be for your subject (the white part of your alpha mask).
The second two IPAdapter images will be for your background (the mask is being automatically inverted to reverse this).
Running the HighResFix at Bilinear will keep you from getting a CUDA on longer frame videos. At 1.5 you will get a clean 768x1344 output after the HighResFix is finished.
Appreciate everyone and all the support I receive.
Special shoutout to @cerspense @Purz @jeru @Fill @MidJourney.Man @PatchesFlows for allowing me to babble about my AnimateDiff wants and desires and helping me navigate how to get there when I hit a wall and hit it often.
Find me on IG @jboogx.creative
Description
This version is for AnimateDiff v3
FAQ
Comments (5)
Hyped !
King Shit 👑
Hi, Im struggling to solve the following error.
Exception in callback ProactorBasePipeTranspor.call_connection_lost(None)
handle: <Handle ProactorBasePipeTransport.call_connection_lost(None)>
Traceback (most recent call last):
File "asyncio\eventy.ps", line 80, in _run
File "asyncio\proactor_events.py", line 165, in callconnection_lost
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
Had no issues with prior workflows, Any tipps on how to fix this ?
Just downloaded the updated workflow, manually updated IP Adapter from its github page and manually reselected some node options. Works perfectly now,
Amazing workflow!!
@xinjxAI what were the reselected node options friend that helped you overcame the Transport issue?
I came over the ipadapter issue by copying and pasting the folder ComfyUI_IPadapter_Plus folder into a ipadapter folder in Comfui/models.
But how do you get over the issue:
Exception in callback ProactorBasePipeTranspor.call_connection_lost(None)
Is it related to the VideoHelperSuite node? While i can run Comfy successfully, this error popups every second in my terminal console which is very annoying.