CivArchive
    Preview 486655
    Preview 489461
    Preview 486684

    STOP! THESE MODELS ARE NOT FOR PROMPTING/IMAGE GENERATION

    These are the new ControlNet 1.1 models required for the ControlNet extension, converted to Safetensor and "pruned" to extract the ControlNet neural network.

    Also Note: There are associated .yaml files for each of these models now. Place them alongside the models in the models folder - making sure they have the same name as the models!

    These models are embedded with the neural network data required to make ControlNet function, they will not produce good images unless they are used with ControlNet.

    To be honest, there isn't much difference between these and the OG ControlNet V1's. These models are further trained ControlNet 1.0 models, with an additional 200 GPU hours on an A100 80G.

    • control_v11p_sd15_seg

    • control_v11p_sd15_softedge

    • control_v11p_sd15_normalbae

    • control_v11p_sd15_scribble

    • control_v11p_sd15_mlsd

    • control_v11p_sd15_openpose

    • control_v11p_sd15_depth

    • control_v11p_sd15_canny

    • control_v11e_sd15_ip2p

    • control_v11e_sd15_shuffle

    • control_v11p_sd15_inpaint

    • control_v11p_sd15_lineart

    • control_v11p_sd15s2_lineart_anime

    • control_v11u_sd15_tile

    Download these models and place them in the \stable-diffusion-webui\extensions\sd-webui-controlnet\models directory.

    Please consider joining my Patreon! Advanced SD tutorials, settings explanations, adult-art, from a female content creator (me!) patreon.com/theally - I also have a write-up of ControlNet and will be updating with the latest news/developments!

    Description

    Softedge

    FAQ

    Comments (49)

    JustMaierApr 14, 2023· 3 reactions
    CivitAI

    Thank you for taking the time to get these updated models added. I'll look into the issue with the ability to add yaml files to ControlNet types of models

    Looks like we already got it addressed and you've uploaded them. It appears the notice isn't showing though, so we'll get that added.

    nicetry20010Apr 14, 2023

    what model did you use on the first picture? it's look awesome

    theallyApr 14, 2023· 1 reaction

    @nicetry20010 Hey, all of these are from my next Ally's Mix - this will be the fourth one. It's geared towards realism but still retains the feel of my work! I really think this one is going to be special!

    halr9000Apr 14, 2023
    CivitAI

    What's the total download size? Mind adding that to the description? I blew out my SSD earlier today with the unpruned ones lol.

    PolygonApr 14, 2023

    You can see it in the Civitai GUI, just tap the files menu on the right to open it and see the files w/ sizes.

    theallyApr 14, 2023

    They're around 700 MB each, and there are 14 of them in total - so ~9.5 GB in total.

    nicetry20010Apr 14, 2023
    CivitAI

    may i know what kind of prompt you used to get that painterly looks?

    countlippeApr 14, 2023
    CivitAI

    Do these work with the existing ControlNet plugin for Automatic1111? Mine is showing the latest as being 6dd043aa (Mon Mar 6 16:59:46 2023).

    theallyApr 14, 2023· 1 reaction

    Yes, but you won't get all the features until the plugin is updated.

    festivalApr 16, 2023· 1 reaction

    It should work now I think, I read it was updated

    victorc25744Apr 14, 2023· 1 reaction
    CivitAI

    It might be good to also mention that these models are not meant for merging into models for generating images, since some people refuse to understand this

    theallyApr 14, 2023· 3 reactions

    I don't think anything I could say will convince them :)

    AlbedowoApr 15, 2023· 1 reaction
    CivitAI

    Will there be also a "Difference" version of this?

    theallyApr 15, 2023

    Unlikely! There was so little variation with the last difference extracts, I'm not sure it's worth it!

    AlbedowoApr 16, 2023

    @theally I see, thanks for the answer!

    spoffninjaApr 21, 2023

    @theally controlnetV1.1 has the lineart models which was not present on V1. So those alone is worth the download

    theallyApr 21, 2023· 1 reaction

    @spoffninja I extracted the original ControlNet models two ways - one was a "difference" extract by calculating the difference between ControlNet and SD 1.5, the other was prune/fp16 - that's what @Albedowo was referring to - I wasn't saying there are no differences between 1.1 and the OGs :)

    omegablast20023899Apr 15, 2023
    CivitAI

    i saw that you have to do a different install for this becuase its not the main control net...is there an eta when controlnet will be bumped to 1.1 officially?

    theallyApr 15, 2023· 1 reaction

    You can use (some of) these with the existing ControlNet extension, but no, no idea when it will officially support all these models. Hopefully soon!

    omegablast20023899Apr 27, 2023

    @theally excited to use them but the set up is rough for me

    theallyApr 27, 2023

    @omegablast2002gmailcom I have a really in-depth tutorial on the Patreon, but if you're looking for free content, I'm sure there's a setup guide on Youtube!

    linkerlinkeadorApr 16, 2023· 1 reaction
    CivitAI

    Thanks a lot for your work! :D
    Can we just delete the old models and use just these new ones? Or should we keep them and use both old and new ones?

    muf00dApr 17, 2023· 1 reaction
    CivitAI

    Thank you for sharing those ConrtolNet models.

    DocShotgunApr 18, 2023· 2 reactions
    CivitAI

    Is the depth model included here based on the original upload of 1.1 or the bugfixed version? Per the original github repo:

    2023/04/14: 72 hours ago we uploaded a wrong model "control_v11p_sd15_depth" by mistake. That model is an intermediate checkpoint during the training. That model is not converged and may cause distortion in results. We uploaded the correct depth model as "control_v11f1p_sd15_depth". The "f1" means bug fix 1. The incorrect model is removed. Sorry for the inconvenience."

    theallyApr 18, 2023

    It's fixed! The model here is the control_v11f1p_sd15_depth model.

    ChewtoyApr 18, 2023· 2 reactions
    CivitAI

    what did you use to convert the models from pth to safetensors? Im asking because this models get updated often and would like to do it myself.

    Vanadium74Apr 19, 2023
    CivitAI

    I am getting A LOT of "Model not found" on these... some of them work, some of them just utterly fail. Any ideas / suggestions?

    theallyApr 19, 2023

    Do you get the same with the official models? I'd be extremely surprised if not. When do you get the "model not found" error? Do you have the .yaml in the same directory, with the exact same name as the model? And you're selecting the appropriate preprocessor?

    Vanadium74Apr 19, 2023

    Well for now they seem to be (at least somewhat) working. Haven't tested everything so far. Also, I should have been more clear- I wasn't meaning to imply there was anything wrong with the models themselves. Yes, the YAML models, which I got from here on the model page, are in the same folder as the models .

    Mostly, I was just looking for help. Anyway, it only seemed to bean issue with certain models. I haven't tried the "official" ones yet. Usually I get the error when I start to generate something with that model. It will make SOMETHING because it defaults to standard SD. I am on Mac M1 and some like Segmentation (I don't know if it's just the pre-processor or the model or both) just give me the finger and utterly refuse to work. that's not your fault as the same happened with 1.0 models and they weren't even yours. This is just the price to pay, I guess, for living on the "bleeding edge" as the saying goes, of technology.

    undeliriumApr 21, 2023· 1 reaction
    CivitAI

    Appreciate all your hard work providing these resources.

    mooncryptowowApr 22, 2023· 1 reaction
    CivitAI

    Thank you so much for providing these! They take up so much less space and work just as well.

    creedukApr 27, 2023
    CivitAI

    tested a few of my creations these models vs full, same seed same result very happy just like the 1.0 models. Huge thanks.

    icingqueenApr 28, 2023
    CivitAI

    What's the purpose of the inpaint model when we can already inpaint?

    theallyApr 28, 2023

    Yeah, I have zero idea!

    icingqueenApr 28, 2023· 1 reaction

    @theally lol ok thanks anyway for uploading it!

    eurotakuMay 11, 2023· 1 reaction

    @icingqueen perhaps it enables you to use any base model for inpainting? so that you don't have to beg the author for a dedicated inpaint-checkpoint?

    supercloud9257Nov 3, 2023

    Controlnet's inpaint can actually outpaint as well using lama or harmonious global, if you have a square image and then in img2img you specify 16:9 ratio and bigger area and select controlnets inpaint+lama, then it will outpaint. There's some tutorials on it if you want more detail.

    l3luel3illApr 28, 2023· 8 reactions
    CivitAI

    Can you please upload the fixed tile model? thank you :D

    theallyMay 11, 2023· 1 reaction

    Took me a while, but it's here now!

    PhilippSevenApr 28, 2023· 2 reactions
    CivitAI

    Someone realize how to use Tile model? When I add control with tile in img2img and use SD upscaler – SD generate same image in all of the tiles...

    Blackhat98May 1, 2023· 1 reaction

    In Reddit there's many examples how to use it even Olivo Sarikas explained how to Upscale using tile model

    Blackhat98May 1, 2023

    I forgot that the current version of tile model here doesn't work well you need to download the update from huggingface

    theallyMay 11, 2023

    @Blackhat98 You can't use SD Upscaler, but you can use the Ultimate SD Upscale extension. You can also combine Tile with "my prompt is more important" to do arbitrary prompt-based transfer (which is what I'm showing in the example image).

    ToxicBotMay 12, 2023· 1 reaction

    You can also use Tiled Diffusion instead of the Ultimate SD Upscale, though I have not had such good results, but I have seen others who have. Just need to play with it more.
    https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111#-combine-with-controlnet-v11-tile-model

    Blackhat98May 1, 2023· 3 reactions
    CivitAI

    Please update of the tile model to the version "e" instead of the "u", control_v11e_sd15_tile

    theallyMay 11, 2023· 2 reactions

    Done!

    evileliotMay 4, 2023· 4 reactions
    CivitAI

    awesome job, please update to the version e

    138759May 5, 2023· 13 reactions
    CivitAI

    Can some Hero update the 'tile' model with the recent update and in .safetensor?
    TY!

    theallyMay 11, 2023· 6 reactions

    Took me a while but I finally got around to it! FP16/Safetensor uploaded!

    Controlnet
    SD 1.5

    Details

    Downloads
    18,702
    Platform
    CivitAI
    Platform Status
    Available
    Created
    4/13/2023
    Updated
    5/13/2026
    Deleted
    -

    Files

    controlnet11Models_softedge.safetensors

    Mirrors

    HuggingFace (54 mirrors)

    Available On (1 platform)

    Same model published on other platforms. May have additional downloads or version variants.