This is the workflow I use to save time processing my videos. Sometimes, when you make adjustments to your workflow, the ControlNet processors might re-run videos that you have already processed. When you don't have a powerful GPU, saving time and memory becomes crucial. Pre-processing your ControlNets can save you both.
This workflow can save videos and images. It will return outputs for OpenPose, Canny, SoftEdge, LineArt, Depth, Main Subject Mask, Selective Mask with prompt, NormalMap, and the original video with the compatible frame rate and size. Additionally, this workflow can remove the background of the original video, restore faces, and perform face swaps.
Description
Changes in v1.1:
Better Depth Processor
Visually more organized
Inclusion of the "Masking with prompt" Workflow.
+Normal Map
FAQ
Comments (5)
what are all the node repos used? I can't find all the nodes used.
With background remover I get an error:
[E:onnxruntime:Default, provider_bridge_ort.cc:1978 onnxruntime::TryGetProviderInfo_TensorRT] D:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "G:\ComfyUI\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll"
EP Error D:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:490 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported.
when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider']
Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.
I do have Cuda 11.8., onnx 1.8.1 and I have all in PATH. I've spent 3h trying to fix it, googling, asking Gemini, but nothing I do seems to work. ANy help would be highly appreciated.
And also, the framerate node doesn't seem to work, I had to replace it. It idled asking for vae. And the video combine nodes can't connect to the aux nodes, so it idles also, had to replace them too. I'm sure these are all noob errors, but still I don't know how to fix them (to make it all work as is I mean). What could be wrong?
And thanks for sharing, amazing work!