Over view
This is a simple workflow designed to closely reproduce the inpainting features available in WebUI. And specifically designed for use with my model, Utopian Inpainting.
Update: Changed sam2 to sam3
Old update: Added Openpose, Detail daemon, fill mask area, basic Adetailer, and more.
I realized the pure SDXL models is good as a refiner. After testing several options, Epic Realism delivered good performance with both high-resolution and low-resolution images.
Set the sampler 2 configuration to "dpmpp_2m_sde" "karras" and try adjusting the "refiner ratio" to around "0.6 to 0.8"
-Basic feauture-
Inpainting with refiner model
Inpainting full image and crop image select
Pre-resize image with scale by % and long_side resize select
Basic K-sampler and Lanpaint support
Manual mask and sam2 Auto masking select
Optional Vae and Clip selector
Postprocess Mask detailer (testing)
Upcoming Update plan: Outpainting Support, More Accurate Auto masking.
-How to use-
Resources you need:
Inpainting Model: Utopian pony inpainting or Any SDXL Inpainting model
Refiner Model: Your favorite models
Optional Clip: Illustrious_base_clip_L and Illustrious_Base_CLIP_G
Settings:
[Optional loader]
Select if you want to use Clip or VAE instead.
[Inpaint mode]
-Normal
Normal Inpainting.
-Refiner
Inpainting with refiner.
-Lanpaint
Use Lanpaint, The output results are different from Ksampler. It is difficult to say which is better.
[Resize method]
-percentage
Pre-resize image with scaled %.
-Long side
Pre-resize the image based on the long edge.
[Inpaint area]
full
Inpaint with pre-resized image size.
-crop
Crop pre-resized image according to mask.
crop target size
Scales the size of the crop from the image.
Cropped_image = Original_img * Pre-resize * crop_target_sizecrop mask extend
How much of the image to crop from the mask.
[Mask method]
-Manual
Right-click on the load image and select "Open in mask editor" to manually draw a mask.
-Auto
A mask is generated automatically; use the mask prompt to define the area you want to mask.
[Postprocess]
-After Detailer
Enhance the Inpainted image by running a mild inpainting pass after finished.
-with refiner
Also use refiner model when Detailer. (With refiner doesn’t perform well at the moment)
Detailer denoise
recommended 0.3 ~ 0.5Detailer zoom
Set how much of the surrounding area is included when cropping.
The higher the value, the more area around the mask will be cropped.
Description
Changed Sam2 to Sam3
I have confirmed that there is a compatibility issue with Transformers 5.
The model is downloaded to ComfyUI/models/sam3. It is 3.2GB and may cause OOM if VRAM is low.
This is a simplified version, so it only responds to single words such as "hair." It does not support expressions such as "hair, boots" or "hair and boots."
Fixed an issue where vae was not switching correctly when loaded.
Inpaint model and refiner model must have the same vae compatibility