Inpaint anything into anywhere using QWEN Edit.
Description
FAQ
Comments (11)
I am using a 3060 with 12GB VRAM and 64GB RAM, running ComfyUI through Stability Matrix.
I have installed all the necessary nodes for the workflow using the ComfyUI Manager and have already rebooted.
However, when I input two appropriately sized images and press “Run,” it stops at the RMBG node.
The Stability Matrix ComfyUI server crashes without any error messages in the log—it just shuts down.
All the models for the RMBG background removal node are properly installed in the folder. I’ve tried the Lite, 512, and HR models, but they all cause the same crash. I can’t figure out what the problem might be at this point.
Are there any additional requirements for using RMBG in ComfyUI on Stability Matrix? Please provide guidance.
Perhaps not enough VRAM, if it exceed 1mb it already fails
hmm, is it possible to add a controlnet pose as well to make the pose more refined or desired pose? like overlapping on a character or at a place?
I haven't done this but try adding the character as image two, then add the pose as image three. something like, "put her here in this pose"
good luck
@GGardens tried but failed. thanks
I got it to work in this workflow. I used the prompt "The woman who is in image3 is in the pose in image2 at the location of image1" and it worked.
Make sure to bypass all of the background removal stuff for the pose image
This worked great, i added nunchaku and fsampler and speed improved a lot too.
can i see that workflow please? :)
@Seismograf you should just have to replace the regular loader with the nunchaku QWEN loader and the ksampler with the fsampler. I haven't tried fsampler yet but it excels with nunchaku. Install nunchaku from the manager and then use the install nunchaku wheel node.
Hi, I tried to have the same result as you, using the same workflow/pictures/etc, but all I get in the end is the masked apollo image (with the white circle), without the werewolf inpainted ; I use a GGUF version of Qwen, and created a mask layer in GIMP (white, and applied the black brush to make a circle) then applied the mask layer and erased the original png ; have I done something wrong (in creating the mask picture, as I didn't touch anything in the workflow), or is the GGUF version not compatible with your workflow ? I get no error. Sorry I'm new to the mask thing.
Problem solved : so for the newbs like me regarding the "how to mask" issue : there is a tool included in ComfyUI that permits you to mask directly a loaded picture : just right click on the picture and select "Open in MaskEditor" then you will easily mask the part you want.. And now it works !