This ComfyUI workflow was mainly created to do one thing in SDXL: "Multiple characters Loras" that embeds every process of how the image is generated.
It's like semi-inpaint that starts from the beginning of the generative process, and is compatible with "Tile Upscale (Ultimate SD Upscale)".
It also works well without character lora.
It works well with AMD GPU, should work with an Nvidia GPU too, if the custom nodes work as intended.
📌Featuring
Illustrious 2.0 Focused Workflow (Supports SDXL models)
Regional Prompts With Regional Lora (Up to 3 characters)
All-in-one Workflow (KSampler/Ultimate SD Upscaler/Detailer/Color Correction/Upscale/Inpaint)
Optional ControlNets (OpenPose, DepthAnything, Canny, SoftEdge, Tile)
Separated Base/Detailer Prompts (less upscaler/detailer hallucinate)
Flexible Workflow Starts (Starts your generation from any part of the process)
Semi-Auto Mask (starts workflow right away without manual masking involvement)
Suitable for users who can navigate the workflow spaghetti.
However, I've arranged the node groups in order from left to right and up and down. Categorized separately by Header and Textboxes. It should make it easier to follow through and input text/number accordingly. With Hotkeys to quickly navigate the workflow
The Guide, how to use, and that sort of stuff are inside the workflow. Ask me if there are any confusing words in the guide that may need improvement in the comments.
Please avoid flooding me with personal chat as best as you can. I encourage posting your question in the comments.
⚠️Forewarning
Backup your Local ComfyUI Environment.
When installing/updating new custom nodes, things can break from forcing to install certain version of site-packages, which may be incompatible with your settings.
Not suitable for impatient users. The workflow is very delayed.
Depending on how many group toggles are enabled.
And if using "Regional Prompt/Lora", it will generate very slowly.
2-4 times slower (depending on how many characters/character loras enabled).
There's a basic auto masking, but complicated poses still require manual masking.
Similar to "Inpainting", it requires tracing the character from the image to give proper facial expression/pose and prevent character features from bleeding.
💾Download Section
🎛️ControlNet (models > controlnet)
Depth Anything - Rename file to "t2i-adapter-depth-midas-sdxl-1.0".
Canny - Rename file to "t2i-adapter-canny-sdxl-1.0".
🔍Detailer (models > ultralytics)
📦BBOX (ultralytics > bbox)
Eyeful v2 Paired or Eyeful v2 Individual (Can use either Eye Detector models)
📐SEGMENT (ultralytics > segm)
🧠Sams Detector (models > sams)
💎Upscale Model
⚠️Known Issue
[If using Load Image node] You need to set your image "Aspect Ratio" to match your "Load Image". Still trying to fix the dependency cycles error when implementing "Auto Get Image Size".
VERY LAGGY/DELAYED when generating due to the sheer amount of nodes and checks on the frontend. Can be remedied by keeping the browser size small.
At the last part of every prompt. You have to manually add a comma "," at the end.
Overburn/Overbaked Image could still happen if using 3 characters Loras, the countermeasure is to lower CFG by 1-3 for KSampler or use Sampler: "Euler_a_cfg_pp" with CFG: 1.3-1.5.
Somehow Sampler: "Euler_a_cfg_pp" in Detailer causes artifacting in the corner, hence I use the standard Sampler/Scheduler combo for this part
[Detailer "Tile SEGS" and Detailer Fix's "Character Bound" Mode] It is somehow forcing the generation outside of the detected area. It still works, but takes unnecessary long generative time.
Credits
Nerdy Rodent (Video Link)
His video sparks my interest in creating this madness AIO of workflow using his method.
Not so simple (or is it?) Illustrious Workflow by @Gladas
took some good sampler/scheduler combo, nodes, and settings from there
Regional Conditioning with AttentionCouple(LoRA supported) by @Nyraen07
Took some inspiration from there too. Also works similarly to mine but with different custom nodes (uses "A8R8 Attention Coupling" + built-in "Set Cond Props" nodes, my workflow only uses ComfyUI built-in "Set Cond Props + Set Default Cond Props")
END NOTE
I took an interest in generating stuff that I'm... interested in, along with gaining some useful insight, and sharing images/videos. This workflow is part of my learning and experimenting node and workflows.
If you find this workflow on another site besides Civitai, the uploader is responsible for providing the support.
I have no way of knowing what gets changed by the uploader.
May you find my personal workflow useful and suits your needs.
Description
Test Release
Adds an example prompt. Can generate everything from start to finish.
Flexible generative process. Continue where you left off with Load Image.
Adds experimental Inpaint using Detailer and BBOX person detector. Manually fixing the bad anatomy part of the image is possible.
There are still a few known issues that aren't generative breaking bugs; just need to be a bit mindful when using them.