Character/style LoRA for the "Sing" movies and shorts, or at least all the characters I could find on the wiki. The XL version should work best on Illustrious/Noob, but also works fairly well on SeaArt and kinda works on Pony-based models (may need more helper tags or higher strength). Style flexibility seems pretty good, however this LoRA also seems to be affecting the background/content more than expected when generating characters, may have been overtrained or some of the new settings I tried caused an issue, will try to fix that in the future. For now, it may help to use a lower weight while generating initially, and increase it while doing the refiner and/or the face detailer step.Update: Version for SD 1.5 created as well using the same data, mostly as an experiment. Can give some odd results (multiple pupils/ears, weird fingers, etc) but that may just be a limitation of the older/smaller model. It does seem to get a couple characters more accurately than SDXL (ex. Ray, the snail), and the style flexibility is a bit better, so there may be some use case.Characters included and suggested "helper" tags, may help get more consistent results on some models. Some characters may tend to generate in their "default" outfit (or with glasses) due to limited screentime, have noted that where applicable, may be manageable with negpip/negative prompting:<ul><li>alfonso (male, elephant, grey body)</li><li>angie (female, dachshund, brown fur)<ul><li>often ends up with a red beanie</li></ul></li><li>ash (female, porcupine, brown fur)</li><li>becky (female, porcupine, brown fur)</li><li>benny (male, corgi, brown fur)</li><li>big daddy (male, gorilla, black fur)</li><li>bob (male, dachshund, brown fur)</li><li>buster moon (male, koala, grey fur)</li><li>clay calloway (male, lion, white mane)</li><li>daniel (male, giraffe)</li><li>darius (male, yak, brown fur, blonde hair)</li><li>eddie noodleman (male, sheep, white wool)</li><li>garry (male, dachshund, brown fur)<ul><li>basically identical to bob</li></ul></li><li>gunter (male, pig)</li><li>harry (male, panther, black fur)</li><li>herman (male, lizard, green scales)<ul><li>usually gives him a plaid shirt and satchel, not many pics of him so poor flexibility</li></ul></li><li>hobbs (male, penguin)<ul><li>often tries to generate with a tuxedo, again not many pics</li></ul></li><li>jerry (male, cat, brown fur)</li><li>jimmy crystal (male, wolf, white fur)</li><li>johnny (male, gorilla, black fur)</li><li>judith (female, llama, brown fur)</li><li>karen (female, antelope, tan fur)</li><li>klaus kickenklober (male, monkey, blonde fur)</li><li>lance (male, porcupine)<ul><li>sometimes will generate a lance (weapon), may need to neg prompt that</li></ul></li><li>linda le bon (female, horse, brown fur, red hair)</li><li>marcy (female, horse, brown fur, blonde hair)</li><li>mason (male, walrus, grey skin)</li><li>meena (elephant, female)</li><li>mike (male, mouse, white fur)</li><li>miss crawly (female, iguana)<ul><li>inconsistent with her glass eye</li></ul></li><li>nana noodleman (female, sheep, black wool)<ul><li>her turban/headdress usually appears in some form</li></ul></li><li>nancy (female, mouse, white fur)</li><li>nooshy (female, lynx, grey fur)</li><li>norman (male, pig)</li><li>pete (male, camel, tan fur)<ul><li>often gives him overalls/cap</li></ul></li><li>porsha crystal (female, wolf, grey and white fur)</li><li>ray (male, snail)<ul><li>doesn't really work well and can't "anthropomorphize" him, snail may just be too weird a species to learn easily</li></ul></li><li>richard (male, bison, brown fur, black hair)</li><li>rosita (female, pig)</li><li>ryan (male, tiger)</li><li>suki lane (female, dog, saluki, brown fur)</li></ul>Tried training the style in as "sing movie style" as well, though it's not particularly distinctive. It kinda works but can make a lot of species not generate correctly, often ending up as something vaguely dog-like with brown fur. Have also seen it generate some of the movie characters, either in place of or next to the intended character, so may be overbaked on those. To mostly avoid that use it at a lower strength ~0.5 and possibly increase strength in the refiner stage.

Sing - Multi Character/Style LoRA

Initial release for SDXL-based models

Files with SHA256: e780043f2b64026c13361b4817ff82849c275fee8fc5a958fed6028c8f362f5b