Update 5-25-2023
(Firstly, I couldn't decide between which one cuz they were both doing different things so I decided to give you both loras. One is very good at capturing the chibi style of the anime but it's a bit baked and saturated which might not work for some people. The other is more tame with the saturation but seems to love focusing on full body shots)
I completely replaced the previous lora with a new one. This one will allow you to get her in different outfits and stuff like that. Funny expressions works now too. Here are some sample prompts:
Her canon outfit: puffy short sleeves, white dress, striped ribbon, skull-shaped ornament, pantyhose, red and white shoes
(Funny Expression) - makes a funny face, generally ridiculous like they were in the anime. It's a great way to just get a random face expression that might be entertaining.
Blue lines on face - Attempts to add those blue lines you see on her face constantly when she's having a mood. Combine with blush for better odds of it working right. Can put it between ( ) to help get the prompt.
Overall it has a lot of room to mess with. CFG scales, additional network weight adjustments, prompts, sometimes the trigger word isn't needed, sometimes it is to get her body proportions right. Fullbody works now, it was finicky before.
I hope this will be fun for everyone! Post your art and let me know what you think.
__________________________________________
Use weight .75 if you want to mix her up with styles and other prompts, weight of 1 will probably work now per update with many outfits but not all. Up to Weight 1 if you want it to be more stylized but also makes it less flexible to work with styles and poses.
Higher steps seems to make better looking eyes and more canon to the anime style.
Play with weight .7-.9 to do various scenes and poses. You can write in "orange eyes" "red eyes" together if the lower prompt weight is messing with her eyes.
If you use the prompt "Funny Expression" and describe some basic face stuff like :o, :3 etc you might get a well, funny expression. I screencapped a ton of her facial expressions. I think the checkpoint makes a difference with what you can get with that however.
She is rather expressive with her face as a result of the images I trained with. Will need to mess with weighs to get her to do what you want.
Lastly, my training data contained a lot of hand shots, many very closeup. This lora has better odds of generating less cursed hands, but you're still going to get bad hands.
Description
This is the final one I'm training, it's less saturated than the alternative one but has issues conforming to uniforms if you don't apply weights correctly. You can get her to wear anything while maintaining her basic hair, eyes etc just use parenthesis ( ) to add emphasis to your outfits and things you want her to hold in her hand.
FAQ
Comments (10)
I was just thinking about training a LoRA of this, so you saved me the work! Thanks!
Thank you! Let me know if there are any problems, I'm not opposed to fixing up some tag issues. For example, I think it defaults to her having a drop of sweat on her face a little "too" much, if it seems impossible to stop that from happening through use let me know. Or any problems at all really.
@NicoY Unfortunately for me, this LoRA seems really hard trained on her typical outfit, and a very specific art style. It's really hard to get Nene to wear different clothes, or play well with any checkpoints or Style LoRAs.
Possibly fixable with different tagging (e.g. tagging every image of her regular outfit as 'defaultoutfit' or something), but I think it's probably a dataset issue (e.g. way too many images of her in her normal outfit, in that specific 1 art style)
I have to lower the LoRA weight to like 0.3 to 0.5 to get the clothes to change and then it looks almost nothing like her. :(
This lora will work great for people who just want to replicate the example images style/content though
@datSato I think it may have accidentally baked her outfit in with the trigger word. I can get her in another outfit if I use additional network and drop the TEnt weight to 0 but if I bring the UNet weight above .7 her default outfit overrides everything. I'll fix it
@datSato Hello again sir, I have spent probably close to 12 hours and I think I fixed it. You can add ( ) between outfit and make the outfit happen in the beginning after quality modifiers. Additionally she WILL make funny expressions if you add that tag using ( ) too. The expressions are a bit ridiculous just like the anime. I got her in a princess gown, police uniform, gym uniform, tracksuit etc without needing to drop the weight too much.
It will still try to generate her in her original outfit 'sometimes' but it isn't as bad now. This is probably the best I can get. The uploaded file is ready for download
@NicoY I'm not totally sure I understand what you're saying - "add ( ) between outfit and make the outfit happen" ?
@datSato Oh you know for example (police uniform) or ((police uniform)) instead of just police uniform. It adds weight to it. But it may not be needed in most cases with the new model, only if you're struggling to get something to fit her.
@NicoY Oh that - for that I specify the weight with numbers for finer control - eg (police_uniform:1.25). But yeah I guess either way works. Anyway, I'm about to give it another go so I'll let you know!
@datSato I uploaded my final one, 10 minutes ago and I added an alternative with some samples to see what that alternative does.
@NicoY "Alternative" works like a charm! It's almost perfect now. Really the only remaining nit pick is that it really still likes that one specific art style (the coloring/shading in particular), would need a lot of fanarts or other sources for images (or regularization) to dispell that. I'm balancing on a knife's edge around 0.7 weight to try to retain her overall look while getting a little leeway on style.
All in all now the LoRA is definitely 'properly made' and functions very well now, I give it an 8.5/10 and will make a review/2nd comment.
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.