EXPRESSION HELPER 2.0
Originally, at the time I imagined this model I hadn't opened my Civitai profile yet, and I didn't make my own models yet. So I did it in collaboration with @cironegrogni and it was very much appreciated.
Now that I've been creating my own models for a while I decided to resume the project on my profile and I brought you the FLUX version, EXPRESSION HELPER 2.0. The XL version is also in progress.
But let's talk about the model:
Flux has already implemented the expressions well, but some are missing and don't always look natural.
I implemented these facial expressions for you:
( sad )
( angry )
( scared )
( happy )
( surprised )
( disgusted )
You can use both tags and captions, both together and individually, my advice is to use the expression tag between parentheses before the caption.
You can also mark it by adding "very" to the expression in brackets, and with additional tags to add after the caption, such as "open mouth", "scream", "smile", "laugh", "terrified" etc.
A tip, when using Flux (in any case, not only with my LoRa) do not overdo it by only putting tags, tags must be used wisely and should only mark concepts that you have not managed to obtain with the caption alone.
DOES IT WORK WITH ANIME?
Quite, but it was not designed for expressions in this style, if this model is appreciated and users want it you can also make an Anime Expression Helper.
Let me know what you think, I look forward to your feedback 😊💜
EXEMPLES
SAD:
(sad), a close up of a beautiful young woman in a room with a sad expression, Her lips is twisted of sad. Her eyes were bloodshot from crying. She have red hair and freckles and is underwater (
very sad), a close up of a beautiful young woman in a room with a sad expression, Her lips is twisted of sad and she cry. She have red hair and freckles and is underwater
(very sad), a close up of a beautiful young woman in a room with a sad expression, Her mouth is open and twisted of sad. Her eyes were bloodshot from crying. is closed and tearfull. She have red hair and freckles and is underwater
(very sad), a close up of a beautiful young woman in a room with a sad expression, Her mouth is open and twisted of sad. Her eyes were bloodshot from crying is closed and tearfull. She have red hair and freckles and is underwater,scream
ANGRY:
(angry), a close up of a beautiful young woman in a room with a angry expression. She have red hair and freckles and is underwater
(very angry), a close up of a beautiful young woman in a room with a angry expression, Her mouth is open and show her teeth. She have red hair and freckles and is underwater
SCARED:
(scared), a close up of a beautiful young woman in a room with scared expression. She have red hair and freckles and is underwater.
(very scared), a close up of a beautiful young woman in a room with scared expression. She have red hair and freckles and is underwater. scream
(very scared), a close up of a beautiful young woman in a room with terrified expression. She have red hair and freckles and is underwater. scream, open mouth
HAPPY:
(happy), a close up of a beautiful young woman in a room. She have red hair and freckles and is underwater
(happy), a close up of a beautiful young woman smile in a room. She have red hair and freckles and is underwater
(very happy), a close up of a beautiful young woman laught in a room. She have red hair and freckles and is underwater
(very happy), a close up of a beautiful young woman laught in a room. She have red hair and freckles and is underwater, open mouth
SURPRISED:
(surprised), a close up of a beautiful young woman in a room with surprised expression. She have red hair and freckles and is underwater.
(very surprised), a close up of a beautiful young woman in a room with surprised expression. She have red hair and freckles and is underwater. open mouth
DISGUSTED:
(disgusted), a close up of a beautiful young woman in a room with disgusted expression. She have red hair and freckles and is underwater.
(very disgusted), a close up of a beautiful young woman in a room with disgusted expression. her mouth is distorted by the disgust she feels. She have red hair and freckles and is underwater.
(very disgusted), a close up of a beautiful young woman in a room with disgusted expression. her mouth is distorted by the disgust she feels, and her expression is grotesque. She have red hair and freckles and is underwater. open eyes
Description
FAQ
Comments (38)
Looks fun! Love it! 🤩 This is typical weight slider material I think. Then you don't have to modify the text prompts. But not sure if CivitAI LORA training supports that technique. If not there is something to improve for them I guess. 😄
Thank you 😊 interesting idea, to do this a separate LoRa should be done for each expression.
Looks nice. Can't wait for the SDXL version :D
Thanks so much! 😍I made one but it doesn't work as I would like, but I'm working on it.
How face altering is it with current lora ?
Sorry I didn't understand the question 😅, can you rephrase it? Thanks🙏
@Lara_De_Martin I'm not the guy who asked, but I'm assuming they meant "with character lora". Since your Lora was trained on faces, then I would suspect that trying to use it with a character/person Lora then the face likeness would be reduced by the expression lora.
@recycleaway7807 Ah! 😮Thanks for helping me understand 👍
Yes, it is correct, surely my LoRa "dirties" a possible character, adding some features of the faces inserted in the dataset.
Thanks for this. Any chance you can type some of the suggested prompts in the description for each emotion as well, like in the images?
Thanks! I tell you that what I have put are indications, but it is not mandatory to compose the prompt as I did, I invite users to test my models also with different prompts, so as to be able to have a more complete feedback. I will add examples in the description of the model, as requested. I would like to remind you, however, not to fossilize only on the prompts that I have proposed, try with other words and other combinations, I am sure that you can do much better than me.🤣🩷
@Lara_De_Martin Those are a great starting point, and the text helps massively.
@ptdurnvcoedqegsdnw great😊💪
trained on young women only, right? Can it do males and ages?
I'm sorry you didn't reach your goals, I assure you that I also included men, elderly people and multi-ethnic people. There is a greater amount of female faces, that's true, but I assure you that there is also all the rest.💪😊
Thank you, very helpful !
Thank you so much 😊❤️💖
finally some more facial expressions. I was getting tired of "le-buttchin-face" that flux keeps generating.
ahah 🤣 Thank you! 🙏😊 emotions and expressions are always a bit missing in the models, I'm happy to have provided you with a useful tool.
@Lara_De_Martin yeah thanks a lot for this . Its a great contribution to the community!! :D
@yofoton174609 😊💜🩷
Maybe you can make a lora for "body expressions" too? With people communicating some interesting poses with their bodies? Maybe it could help people generate poses with more simple prompts? "jumping happily" , "sad and depressed" , "curious". Maybe by doing this the LORA would learn to combine these emotions into new body expressions? That way we could maybe discover new body expressions?
@yofoton174609 I thought about it, but I think that for this kind of results the img2img method with an openpose controlnet is perhaps more effective, in order to obtain maximum customization. I was thinking about creating a LoRa of hand poses, with objects etc, but it seems very complex. In any case your idea is interesting. I will think about it. Thanks 😊🙏💜 Ps. I'm about to release Expression helper anime, check it out if you like, it's really fun.
@Lara_De_Martin yeah i know about pose controlnet. But pose controlnets are annoying :P
But yeah, thanks for this. It could be a cool series with "expression enhancers", "dramatifiers" . Aristotle considered drama one of the great arts after all :P
@yofoton174609 you're right! Everything that can bring AI closer to the expression of the human soul fascinates me a lot! 😊💜
@Lara_De_Martin yeah imagine a lora for "dramatic feet expression", a "Dramatic hands" , a "dramatic mouth", "dramatic eyes" and so on. With these people could get ultra specific with their inpainting, and then just get what they actually want: Drama! Drama in the right places by just "painting in the drama!"
@yofoton174609 Very interesting, the dramatic feet, the more I think about it, the more it seems like a fun idea! 😊
@Lara_De_Martin yeah dramatic feet would be perhaps, curled up feet, toes stretched out etc. And then of course it could be "de-dramafied" by just using a negative value on the lora :D. It would be an interesting experiment that focuses on the human body. Maybe eventually it will understand what drama means as a general concept and perhaps even transfer it to animals and other objects?
@yofoton174609 Flux learns differently, it could learn, as well as unlearn, in fact sometimes it happens to me that in LoRa it learns new things but worsens its scores in anatomy 🤣
@Lara_De_Martin yeah. good point. i think the only hope is to make it learn for micro-parts that could be used in inpainting. The LORA seems to disrupt the overall consistency too much
the download link is broken =(
I'm sorry, but everything works fine with the download, try again, maybe it was a temporary disservice from civitai.😊
waitting for Kontext version.
Cany you make a lora for Flux Krea? Because most Loras from flux dev work on krea but with this one the result is always blurry and grainy.
Training on Krea requires doing it locally and isn't currently in my plans. However, I might do additional training and some tweaking to make it work better on Krea. I hope to be able to accommodate your request soon. In the meantime, since you like my models, follow me to stay updated 😊💪💜
Oh man, it's nearly perfect, but changes the face of my character LoRA, I hope you release a non-face altering version.
Oh man, you hit a sore point. Unfortunately, I have to feed a dataset for the model, and the dataset, although mixed, includes multiple expressions of the same people to ensure consistency in the results, and this, by the nature of the model, changes the features of your character, I'm aware of that. But let's not despair, since other users are having other difficulties, I thought I'd work on a new version to try to achieve fewer errors of this kind and better rendering quality even with the Krea model. Wish me all the best! Follow me to stay updated 😊💪💜
Details
Files
expression_helper2.0.safetensors
Mirrors
expression_helper2.0 _(SAD, ANGRY, SCARED, DISGUSTED).safetensors
expression_helper2.0.safetensors
expression_helper2.0.safetensors
expression_helper2.0.safetensors
expression_helper2.0.safetensors
expression_helper2.0.safetensors
expression_helper2.0.safetensors
expression_helper(what).safetensors
Expression Helper 2.0 for FLUX.safetensors
Available On (3 platforms)
Same model published on other platforms. May have additional downloads or version variants.