Ultimate ComfyUI SDXL/PDXL/Illustrious Workflow
My ComfyUI SDXL/PDXL/Illustrious workflow features three upscale/refine stages, OpenPose ControlNet, numerous detailers, and a neatly organized structure. Most options are easily configurable via the dashboard, using dropdowns or boolean toggles.
Notes:
You will need to download the various bbox models to successfully run the detailers. You can find these models on huggingface/civitai. You can find the SAM model in the ComfyUI model manager.
You can disable detailers by bypassing the detailer node. You can also disable the entire group and the model loader. However, you must leave the
get_DETAILER_*_IMAGEnodes enabled.
Features:
- Dual Model Setup: Enables a stylized model for initial generation and a secondary model for refinement/upscale stages. I typically use a PDXL/Illustrious model as the secondary one, as it excels at handling human anatomy, hands, and faces.
- Three-Stage Sample/Upscale Design: Provides full control over upscaling and sampling, unlike consolidated HiRes Fix nodes. The incremental approach reduces artifacts and distortions while preserving details from the original generation.
- Control Panel: Centralizes easy configuration of models, settings, and more—all in one place.
- Consolidated Prompts: Dedicated locations for all prompts and detailer prompts.
- Prompt Bypass Options: Bypass stage 2/3 prompts with a single click to use one positive/negative prompt across all stages. Selectively bypass positive, negative, or both.
- Full Scaling Control: Adjust scaling factors for each stage independently.
- Pony Toggles: Automatically add Pony scores to prompts if desired, keeping prompts clean and organized. This can be edited, and the text replaced, for embeddings instead.
- Image Loader and Switch: Supports img2img or txt2img modes, with optional inversion and tinting.
- LoRA Stacks: Separate stacks for stage 1, stages 2/3, and detailers, offering maximum control over LoRA application.
- Automatic Image Dimensions: Handles width and height automatically (conditioning and scaling).
- Eight Detailers: Includes hands, breasts, penis, butt, vagina, face, eyes/mouth, and jewelry.
- Precise Masking: All detailers use bounding box (bbox) and Segment Anything Model (SAM) for accurate masks.
- Hand Detailer: Utilizes OpenPose ControlNets to guide refinements for hands and fingers.
- Face Detailer: Employs MediaPipe FaceMesh for ultimate control, detecting face, eyes, pupils, mouth, etc., individually or together.
Dependencies (Custom Nodes):
Comfyroll Studio
Custom Scripts
Dream Project
Impact Pack
Inspire Pack
KJNodes
Tiled Diffusion
Easy Use
Description
Initial Version
FAQ
Comments (3)
There was an issue with the regex mangling the prompts for V1.0, this has been corrected.
Thank you for your interesting workflow. Stage 1, 2 and 3 works like a charm here. But each Detailer fails here at the "ToBasicPipe" (missing model). Do you have any recommendations?
Prompt executed in 323.61 seconds
got prompt
Failed to validate prompt for output 449:
* ToBasicPipe 563:
- Required input is missing: model
* ToBasicPipe 557:
- Required input is missing: model
* ToBasicPipe 534:
- Required input is missing: model
* ToBasicPipe 483:
- Required input is missing: model
Output will be ignored
Failed to validate prompt for output 419:
Output will be ignored
Failed to validate prompt for output 424:
* ToBasicPipe 589:
- Required input is missing: model
Output will be ignored
Failed to validate prompt for output 612:
* ToBasicPipe 741:
- Required input is missing: model
* ToBasicPipe 606:
- Required input is missing: model
Output will be ignored
Failed to validate prompt for output 610:
Output will be ignored
Failed to validate prompt for output 395:
Output will be ignored
Failed to validate prompt for output 407:
Output will be ignored
Failed to validate prompt for output 432:
Output will be ignored
Failed to validate prompt for output 409:
Output will be ignored
Failed to validate prompt for output 415:
Output will be ignored
Failed to validate prompt for output 433:
Output will be ignored
Failed to validate prompt for output 408:
Output will be ignored
Failed to validate prompt for output 414:
Output will be ignored
Failed to validate prompt for output 609:
Output will be ignored
Failed to validate prompt for output 461:
Output will be ignored
Failed to validate prompt for output 756:
Output will be ignored
Failed to validate prompt for output 761:
Output will be ignored
Failed to validate prompt for output 694:
Output will be ignored
Failed to validate prompt for output 399:
Output will be ignored
Failed to validate prompt for output 641:
Output will be ignored
Failed to validate prompt for output 755:
Output will be ignored
Failed to validate prompt for output 431:
Output will be ignored
Failed to validate prompt for output 397:
Output will be ignored
Failed to validate prompt for output 396:
Output will be ignored
Requested to load SDXL
This is just a workflow, it doesn't provided the necessary detailer bbox models. You will have to obtain the various detailer models from hugging face or civitai.com, then set them in their respective loaders in the control panel. Or you can disable bypass the detailers and detailer model loaders.