NoobAI-XL ControlNet
This is the ControlNet collection of the NoobAI-XL models.
How to use?
Version name is formatted as "<prediction_type>-<preprocessor_type>", where "<prediction_type>" is either "v" for "v prediction" or "eps" for "epsilon prediction", and "<preprocessor_type>" is the full name of the preprocessor.
You HAVE TO match the preprocessor type and this ControlNet model.
You MAY NEED TO match the prediction type of your base model and this ControlNet model.
Where is Openpose?
Find it here!
Description
Thanks to Neko Kazama for the compute sponsorship, this model was successfully implemented!
FAQ
Comments (36)
welcome to tile！
Awesome I was literally searching for a tile controlnet last night and gave up, so pleased!
somebody can teach how to use tile? :C
I just made a workflow for using the tile CN and it works quite well. Try checking it out:
Workflow JSON
Wait a minute, are these controlnet models only compatible with NoobAIXL Epsilon models and not vpreds?
You can use it fine with V-Pred or EPS. They're just not made specifically for V-Pred, but it works really really well!
could you make a inpaint controlnet? it would be useful, at least for me it would. Thanks for all of your work (and anyone who helped) for making these. :)
can' t agree more.
what differentiates inpaint controlnet from usual inpainting?
@Korewaai Well, for me it is good at removing clothing on characters or replacing clothes with different clothing (way better compared to normal inpainting), that is what I personally want to use it for. Basically have a better control on the image. When I used it when there was only 1.5 available, I used it in img2img and it somehow added detail and knew what I wanted than simply inpainting it normally.
Not a perfect solution, but the tile model can be used as a makeshift inpaint model in a pinch.
Does it work with Illustrious?
Pleeeeease do v-pred controlnets. These eps controlnets work with v-pred models but sometimes the output generates with some minor burned edges or artifacts (mostly with canny or lineart models). It's not that often but it gets kinda annoying after a while :(
thanks for this comment, i thought it was me.
tile伟大，无需多言
Where do you place this file? In the usual models/controlnet folder?
InstantID or IPA for IL please
@Euge_ Need instantid too
This works greatly on normal NoobAIXL models (both Vpred and eps), and yes, it works on Illustrious.
However, this controlnet is strongly biased towards 2D contents, so using it on 2.5D models will destroy the style. You can partially counter this by lower the strengths, but then the effects of the controlnet will be less too. Unfortunately I haven't been able to find a perfect way to balance this.
Yeah. Unfortunately, that's part of the nature of controlnet.
Any hugginface or diffusers version?
Hi, you may refer to here: noob-sdxl-controlnet - a Eugeoter Collection
Scribble x-dog not available?
are there any differences between the three lineart models? or can I use them for any art
I think the difference is small. Canny would be enough for most cases.
Hello! Civitai finally added "NoobAI" category. Please change on it.
"Version name is formatted as "<prediction_type>-<preprocessor_type>", where "<prediction_type>" is either "v" for "v prediction""
So I guess there is only for eps then?
Thanks for educating us.