Everyone's favourite sith lord / dumbass himbo.
Jar Jar is probably my favorite joke character, but I also kinda feel he's a great way to test out LoRA training on different models as his character design is different enough to push the capabilities of the trainer.
Description
Complete rework of dataset, adding movie screenshots, as well as more nsfw art pics. Trained on much higher step count to prevent anatomy under training.
Below are the training params. As said the steps are probably a lot higher than they needed to be, but I wanted to prevent issues with his eyes again like in V1.
149 images:
{
"engine": "kohya",
"unetLR": 0.0005,
"clipSkip": 2,
"loraType": "lora",
"keepTokens": 2,
"networkDim": 16,
"numRepeats": 4,
"resolution": 1024,
"lrScheduler": "cosine",
"minSnrGamma": 5,
"noiseOffset": 0.1,
"targetSteps": 2980,
"enableBucket": true,
"networkAlpha": 8,
"optimizerType": "Prodigy",
"textEncoderLR": 0.00005,
"maxTrainEpochs": 20,
"shuffleCaption": true,
"trainBatchSize": 4,
"flipAugmentation": true,
"lrSchedulerNumCycles": 3
}
FAQ
Comments (5)
"The ability to speak does not make you intelligent" - Quigonn Jinn
Hear meesa out
I keep running into an issue with extra eyes on the face.
Hey. Yeah I suspect that's due to illustrious sometimes thinking his eyes are actually ears, it seems to stick around no matter how much I train the lora. Unfortunately I don't have any perfect solutions, but I can suggest these 3 things.
1. Lessening or removing any tags related to emotions or eyes, like "shocked" or "looking at viewer"
2. Trying a different checkpoint or using less style loras if you're using those.
3. Increasing the weight of the lora.
Some more info on the Anima version. Recently went on a trip and decided to see what happens if I left it training non-stop for a few days, this is the result. It's about 3x more trained than what I'd usually do with a LoRA like this. Seems to have had some interesting effects. The anatomy is more consistent than the Illustrious version, but the Bananadaboi style is heavily baked in. So overall I'm not all that happy but it's better than nothing. I've added details in the version description for how to lessen that styling issue.