ComfyUI Workflow
navigate with the num keys 1-9 in this workflow.
every group that you dont want to use can be bypassed.
e.g. if you want to load a video or images and do just a face swap on them... go for it.
every sampler can be used as standalone, that means if you run the first one (e.g. KSampler (Denoise)) you can load the images created from this sampler via the input images group and run the second (wich can be every sampler in this line 1st Pass, 2nd Pass and or Latent Upscale) and so on.
the reason for that is, if you run out of memory on some point and you most likely will, you can load the last created images and re-start from there.
you can also use this as Post-Prod. (load a video or images and start at the face detailer, face swap, face restore or what ever comes to your mind) BUT bypass the groups, don't use mute (NEVER).
Version 4.5
noticed an issue with the length of the prompt, batch prompt raises tensor size errors if the prompt is too long so its possible to disable it now if not used. (the main reason for this early update)
if you want to use batch prompt and this error apears, change you prompt.the description of the subject should be in the batch prompt not app-text.
input area changed
put multible files (videos) or folders (images) in the multiline text fields and select the line (0 to x) you want to work with. you can switch it to increment so it changes with every queue
e.g. if you have splitted a video into scenes and saved the images into different folders you can run all folders with the same settings if you like.
or if you want to run multible videos with the current setup over night.
changed the checkpoint loader because the efficientcy loader is constantly changing its size and getting bigger and bigger. its a custom node group now.
theres a vae input switch in this group: 1 = checkpoint vae, 2 = alternate vae.
batch prompt switch on/off
Match Color group changed
there are 4 ways now to use match color:
use the colors of a loadad image via load image,
use a video file or
use images from a folder or
the input images (standard).
use one of theses methods, disable the others. if you disable all of them the input images are used. All of them using just one image because of the difference in size (batch_size).
the reason for that is, if you load previously created images from a sampler, match color is useless because the input images are rendered and not from the source material.
Version 4
almost perfect subject isolation by using a controlnet preprocesor.changed the masking area
added remove background
adopted portions of the v2 workflow from jboogx
added 2 ipadapters
added hires fix for the denoise ksampler and changed it back from standard to the efficient one.
added a prompt scheduler. can be disabled by switching the conditioning input switch to 1. if you have to use multible queues to process all frames, batch prompt is not working or it starts from 0 everytime... the last time ive messed around with the start frame it did not worked out, but maybe its fixed. this could be something to try.
removed the group latents because empty latent was not working on the 1st Pass sampler like it was set up. instead, i have added individually adjustable vae encodes for both samplers (Denoise and 1st Pass). this allows you to chain them or disable denoise and start with 1st Pass. start with 2nd Pass would be dumb thats why theres none xd.
because an empty latent is something really boring I've added noise injection to it. ;)
both groups: remove background and controlnet replace background requires the group masking, so dont disable it.
check if skip: queue * load-cap is = 0 and set to fixed. sometimes i forget to reset this.
Version 3.5
added overlap (e.g load-cap = 100 overlap = 15 will render 115 images in all runs. skip images will always start at the load cap wich means that you have 15 frame on the end of the last run and 15 frames on the start of the current run that can be used for blending. on videos with 30 fps 15 frames will be 0.5 seconds for a cross fade).
load cap = 0 will render all frames/images disable overlap in that case (set value = 0).
fixed the evaluation of skip images: Skip: Fixed Value combined with the queue didnt worked so far. now you can use them together: queue + skip a fixed amount of images on start + overlap.
added a new aio controlnet group.
added conditioning input switch for the controlnets to keep it "clean", bypassed groups are not influencing the conditioning anymore.added prompt everywhere in the prompt group in case all controlnets are bypassed, its inactive if 1 controlnet is active.
with low denoise values on the sampler you don't need controlnets (just a hint).
added video combine to get the upscaled result.
Version 3
rearanged some groups
added a lora stack loader
changed the wildcardencode to the wildcard processor node. (used Wildcards, extract them and copy to "\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\wildcards", restart the server.)
changed the image blend node in the controlnet lineart/hed because at this point i ran out of mem a lot. the downside of this node is that it can not work with batches. thats why i converted the batch to a list at this point for the controlnet groups alone. it takes a while with a big batch. thats why i've added the softedge+ from a jerry davos workflow. i think its faster but i like my lineart/hed creation so i keep it xd. with both of them you can use the models: canny, lineart and softedge ;)
color match is now before the face swap node. face swap is doin a color match anyways (face only) but this allows to change the color with the filter adjustments and there is no rebatch needed in every group.
theres a new node for sharpen the image before applying face restore to sharpen the whole image. the images may no longer look too sharp on the face after the restore is done.
upscale is now the last node (skip this if you have a workflow for upscaling the video).
added noise injection to the latent upscale sampler group and the option to enable or disable both, the upscale model and the noise injection.
updated and tested a lot for memory usage
updated the preview areas and video combine and some other stuff.
the author of vhs (video helper suite) has changed the frame_rate of video combine from int to float. in old workflows you can fix this by changing the frame_rate from input to widget and back and replace the int node with a float.
Version 2.1
fixed a connection issue
was running out of memory on the latent upscale group, loaded the created images from the ksampler via input image to rerun the whole thing (without ksampler (denoise)) and noticed that the latent upscale group didnt received an image input :( sorry for that
connected ksampler (denoise) and 1st pass in case you want to run them all together.
changed the rebatch size from 1 to 10 (to much ram usage if its 1)
Version 2
scale image can be disabled now
added bookmarks for faster navigation (num keys 1-5)
added vae encode to use the original image as base and a ksampler with denoise only
added latent upscale on pixel space
changed the way rebatch is used
replaced video matting with a new node
changed the color match input for the reference image to one image instead of the complete input-batch
Version 1
supports wildcards and loras in the prompt, 2 controlnets, replace background (controlnet).
should work with low vram (using low rebatch values)
each group can be disabled
easy to use in steps.
each group saves the results. so if you run out of memory you can load the last created images and continue where you left off. (simply switch off the previously used groups beforehand)
the overlapping technique sucks, so try to take as many pictures as possible in one go.
Wildcards: https://civarchive.com/search/models?sortBy=models_v7&query=wildcards
Motion Model: https://civarchive.com/models/139237?modelVersionId=154097