Dark's Heterochromia Helper (BETA)
v0.4 - Yep, STILL a work in progress. I realized that I'd been using Flip_Augmentation while training this LoRA. 🙄 That completely ruins the the whole concept as it flips the images during training, essentially nullifying my left/right tags. With that disabled, it's a bit more consistent now. Still not 100%, but we'll get there. 😁 I highly recommend using ADetailer if at all possible (see gen data).
v0.3 - This is STILL a work in progress. I've made a few tagging changes, added Hazel as a color option, and trained the whole set for 5x the original steps. It's still not 100% right, but it's a bit more consistent now. I highly recommend using ADetailer if at all possible (see gen data).
v0.2 - This is very much a work in progress. It's nowhere close to where I want it to be; however, I want to play around with it in the CivitAI Generator, so I figure I'll let you all do the same. It is capable of generating things from your nightmares... I warn you. 😅 I highly recommend using ADetailer if at all possible (see gen data).
Color Options (Danbooru Eye Color Tags):
Amber, Aqua, Black, Blue, Brown/Hazel , Green, Grey, Orange, Pink, Purple, Red, White, Yellow
Usage:
After a lot of testing, I've found that the following example works about 75% of the time. The right and left eyes are from the subject's perspective, not the viewer.
Note: This LoRA and the trigger words should be at the very end of your prompt.
heterochromia - Triggers the effect
COLOR eyes - Call out each eye color
right eye COLOR - Right eye color
left eye COLOR - You get the idea...
Example:
<lora:Dark_Heterochromia_Pony_v0.2:0.5> heterochromia, COLOR1 eyes, right eye COLOR1, COLOR2 eyes, left eye COLOR2,
<lora:Dark_Heterochromia_Pony_v0.2:0.5> heterochromia, amber eyes, right eye amber, aqua eyes, left eye aqua,
<lora:Dark_Heterochromia_Pony_v0.2:0.5> heterochromia, purple eyes, right eye purple, pink eyes, left eye pink,For the other 25%, you can recreate the image by using "BREAK, reversed". This seems to "fix" those images that get the coloring backwards. The image may not be exactly the same, but pretty dang close.
Example:
<lora:Dark_Heterochromia_Pony_v0.2:0.5> (heterochromia, blue eyes, right eye blue, green eyes, left eye green), BREAK, reversedOriginal - Colors Reversed
Fixed - "BREAK, reversed" to swap the colors
And that's it! Try it out and let me know what you think!
Description
Work in Progress - Highly Experimental! Works best with ADetailer and HiRes Fix.
If you find something that works well, I encourage you to show the generation data so we can all learn together! 😁
Recommended Weight: 0.5
FAQ
Comments (6)
Love it. Looks nice, good job. Heterochromia is one of my favorite things.
Same! I'm glad you like it! Still a work in progress... 😅
Hey Dark, super cool model, I saw this the other day and thought it would probably pair very well with my own Eyeful eye detecting checkpoint for Adetailer/Comfy inpainting.
In this way, you could generate a normal image without the Heterochromia Lora affecting your generation or even the face, and then invoke the lora only in the detailing phase and only on the eyes. Hopefully avoiding some of the nightmares you were talking about :D
That's a great idea! I always try to make my models as friendly as possible for people using the CivitAI Generator with no access to things like Adetailer, but I think your suggestions could give the best results overall. I'd love to see some examples if you have the time. (I don't have access to my powerful rig at work for 2 weeks.) 😅
@Dark_Arts Done, added posts to this and your Amber LoRA. And a cross-post from Eyeful that seemed to not want to link to the Heterochromia lora for some reason even though it's in there https://civitai.com/posts/3704206
@32Bitshifter thanks so much! They look great! I'll play around with it some when I get a chance and recommend some ADetailer settings for Eyefull! Thanks again!