Simple LoRA to help with adjusting a subjects skin tone. You can swing it both ways pretty far out from -5 to +5 without much distortion. Positive gives them darker skin. Negative gives them lighter skin.
It is a small LoRA. An experiment in concept strength shifting.
Description
FAQ
Comments (35)
Works on anime to, not just realistic! I've been hoping for something like this! This one gives consistent results, good control, and doesn't require a prompt. There aren't many skin tone loras and all the ones I've found are hard to control and often require the use of the 'dark skin' prompt, which causes yellow stuff to appear in the hair (horns, ears, hats, hairpins, etc) due to some quirk in the training data for SD 1.5. This one is far better than the others I've tried. I'd guess I'm able to get the results I want with probably 1/10th the renders I was needing before.
Funktioniert leider nicht
Can you provide more info on how to make similar slider type loras like this?
Currently it is some frankenstein script with a lot of hardcoding in for each concept. I am working right now on putting together an easy training script. Short answer though is that it does not use a dataset, it shifts the activations in the model from one concept to another. It still requires training, but it trains on itself and data the model generates on the fly. I'll update when I get something put together.
@Ostris thanks! looking forward to hearing more :)
@Ostris have you looked at or are you using something similar to the rome technique in LLMs? It's a technique for locating and editing facts in language models, seems like something similar could be useful here. rome.baulab.info has links to the paper, code, and a Yannic Kilcher video on it if you're interested.
@Ostris I like all of your recent work but I'm still kinda curious about how to do it.. some update would be very helpful.
The woman is sort of a copper tan that does qualify as "black or afro" but could u also consider adding brown and dark brown as well?
Your works are amazing! With my model are working very good (I've put your work in resources tab).
It's so easy now for me changing skin tones and gender!
Can I ask you if you have in project a "animal anthropomorphic" one?
It could be a life saver for me!
I have tried doing one from specific animals to human and vise versa, but it did not turn out well on initial run. I have improved my algorithm though and will give it another shot with just generic "animal" to "human" which may allow you to set the animal with a prompt, not sure. I'll see what I can do though.
Nice! Just like the darkness control on my toaster.
Really amazing work! Can you provide some details on how you train a model on such a narrow concept? Are you using ConceptMod (https://github.com/ntc-ai/conceptmod) or something similar?
I am looking for a "camera angle versus hair fall angle" slider, say, if the person is looking at a camera on ground perpendicurlarly, the hair falls toward the viewer; If the person is upside down, the hair falls upward; If wind is blowing from behind; the hair is like the photo of this LORA....etcetc. Hope you will one day make it.
You missed your chance to name this "Diversity Slider" 😂🤣😂🤣😂
Joke aside, good thing i discover you works. TY for making these LORAs!
Would have been 🤌
I'm trying to do something like this for XL and was wondering how you trained this and prepared the training data? I'm not so ambitious as to try and do one that covers a range like this, but I'm working on a specific character that requires very white skin/albino skin. I have some images but I'm trying to sort out how to prep them to accomplish the end effect...
Absolute Gamechanger
Fantastic work!
I can't get this lora to work at all, although I got some of your other ones like curly or muscle to work great.
Not sure what I'm doing wrong..
-3 and +3 give the exact same image, like the lora isn't there at all.
Here's the png info of my own attempt to get this to work, I changed a bunch of things to match your images as much as I could to see if that helped, but it didn't.
photo of a woman on a jet ski, taken from the front, blue tank top, smiling <lora:skintone_slider_v1:3>
Negative prompt: cartoon, cgi, render, illustration, painting, drawing, bad quality, grainy, low resolution
Steps: 30, Sampler: DPM++ 2M Karras, CFG scale: 7, Seed: 2054516889, Size: 512x768, Model hash: 99a75a901f, Model: Realistic_Vision_V5.1_fp16-no-ema, VAE hash: c6a580b13a, VAE: vae-ft-mse-840000-ema-pruned.ckpt, Denoising strength: 0.28, Hires upscale: 2, Hires upscaler: None, Version: v1.6.0
So, yeah, if anyone has read this far, and knows my mistake, please let me know :)
Are you getting errors in the console? The download may have gotten corrupted or something preventing it from loading.
@ostris I'm not getting errors in the console, but, I never get feedback about lora's in the console. The way it's working, is as if, I've specified a lora that doesn't exist, and so it's just ignored. hmm. Redownloading couldn't hurt to try though!
@ostris Your advice was useful, I eventually figured out, yep, the lora is not being used at all. So.
This is not the valid syntax somehow? It's treating this as if it were not there. Maybe I've got a typo somewhere in the name? Or maybe there's a trigger word I don't know about? That's the difference between my images and the examples on this page. The only difference. Mine aren't using the lora at all :)
<lora:skintone_slider_v1:4>
Okay problem solved. I was foolishly typing
skintone_slider_v1
when I needed to use
skin_tone_slider_v1
it works perfectly now!
now why was I typing it wrong? I was copy/pasting it from the png info of the example images. The author of this lora changed the name of the lora after making the example images and I was too silly to check the filename for that missing underscore, whew, at least I got it working now!
seems dark skin has a bias towards nudity
@sci Agreed. I'm trying to figure out how to generate a similar image after adding a darker skin tone adjustment. I've had some success with adding the clothing adjuster.
For anyone having this issue, try the nsfw embedding as a negative prompt. It usually helps me in other scenarios.
It seems it has a bias towards cropping out the face, I'm not really sure why. Out of 10 images generated with this, and "portrait" included in the prompt, only half showed the girls face
Little late but, you have to tell the LoRA where to focus. Adding pov face in your prompt works.
RIP actual Black People from African countries and Nordic Whites :P
Upping the values skews my images towards more feminine (trying to generate male). You wouldn't happen to have plans for a slider that can actually produce multiple skin colors, including non human ones (thinking gray, blue, green for fantasy characters, D&D and such...) I find that color prompts as skin descriptors tend to produce severe biases on the AI for things not related to color at all: puting ivory or pale leads to much more feminized results. (Oh and I tried correcting with your gender sliders to varying success..)
I'm trying to use this in comfyui but it does not seem to affect the result at all. I loaded it using a Load Lora node and added it to the workflow. Is there anything I'm doing wrong ?
Doesn't work in Auto1111 either. I went from -6 to 6 and it changed absolutely nothing.
@slartibartfast69 It depends on the check point and loras. Many checkpoints can't do anything but caucasion. Not even tan.
Details
Files
skin_tone_slider_v1.safetensors
Mirrors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
肤色滑块_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
skin_tone_slider_v1.safetensors
Available On (2 platforms)
Same model published on other platforms. May have additional downloads or version variants.