CivArchive
    ← All articles
    Published June 13, 2024by mnemic

    List of things SDXL is bad at generating

    712 views7 reactions13 comments on CivitAI8 collected
    training ideasresource guide

    Having generated a bunch of images, I feel like there are a bunch of items that SDXL just doesn't understand.

    A general tip for when you're not getting what you want, try to describe the item in more detail. Could you add additional context, perhaps which type or breed of dog you are trying to generate. They are not all the same after all.
    
    Try searching wikipedia for some information about the subject, and add keywords found in that article.

    My idea is to try to crowd-source and create a list of things that it's just bad at drawing.

    The purpose of this list is to have a starting point for fine-tuning models. Maybe each of these items should get a LoRA that specializes in it, which handles all styles, which we can then use to universally improve the quality of base models.

    SD1.5 version of this list

    SDXL version of this list

    SD3 version of this list

    List of things that SDXL models in general has trouble generating:

    • Hand

    • Foot

    • Nipple

    • Winking eyes

    • Snake

    • Swan

    • Dog

    • Cat

    • Parrot (non-macaw)

    • Dragons (diverse, detailed)

    • Gryphons

    • Cerberus

    • Umbrella

    • Tennis Racquet

    • Scissors

    • Bow and arrow

    • Sword

    • Rusty swords

    • Hammer

    • Anvil

    • Power line

    • Galaxy that isn't The Milky Way

    Lisk of things that SDXL generates always looking the same

    • Dragons

    • Hourglasses

    • Snakes

    Please contribute to the list with comments below. If you can post to images of a the generated object, that'd help even more!

    Please keep your suggestions in singular to make it easier to parse and search for.