Studio Ghibli style LoRA
Making models can be expensive. Do you like what I do? Consider supporting me on Patreon 🅿️ or feel free to buy me a coffee ☕
I know there are already various Ghibli models, but with LoRA being a thing now it's time to bring this style into 2023. This is good around 1 weight for the offset version and 0.65 for the old one, on Anything v4.5 for a more authentic style, but it's also good on AbyssOrangeMix2. Triggers with ghibli style and, as you can see, it should work with any character LoRA or TI that didn't overfit on style too. Keep in mind, this is a style model not a "Ghibli characters" model, so movie characters in the examples are made using careful prompting, meaning it can reproduce similar characters, but it won't make them perfectly (unless you also use other TI/LoRA's).
4th pic by Karkaz using also his own character LoRA.
Last pic by LottaLewds.
How to use LoRA's in auto1111:
Update webui (use
git pulllike here or redownload it)Copy the file to
stable-diffusion-webui/models/loraSelect your LoRA like in this video
Make sure to change the weight if needed (by default it's
:1)
Description
FAQ
Comments (21)
Eyuuus, so excited!
gosh... you are so good. is this LoRA dreambooth or fine tunning? spectrums are just amazing... zelda in combo WOW
Legendary
WHOA
Is there your guide/settings for your LORA's training?
no, I never made a guide, nor will I. There are more competent people doing it already.
I may make a guide on how to do a good dataset tho, as that's 99% of the work.
@Lykon that would be nice. Still, i don't ask for in-depth guide, just what main settings such as learning rate, epochs, batch, clip skip do you use for training?
just go with the default ones. It's really not important.
@Lykon hi bro, your Lora looks so amazing, will you share your experience about making good datasets for training high quality Lora?
amazing, works ok with the Ghibli grain upscale model, did you use any of the screenshots they released for artists to use ("within the scope of common sense") a couple of years ago in the model (https://www.ghibli.jp/info/013344/) ?
no, I just used screencaps from the movie. Making a model to imitate a style (also not 100% perfectly) should be fair use.
@Lykon the images were released as fair use, also what do you commonly use to source images for the models
@stygianwizard42 fair use really depends on what you do with those images. If you sell them, that's not fair use anymore. Anyway, what I use to make the dataset really depends on what I'm trying to achieve.
Your works look fantastic, but could you please also upload a .pt file alongside with .safetensors one? I couldn't get .safetensors working on AUTO1111: https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/7172
How do you know that saving as pt would work? Anyway you can just checkout a previous commit hash
@Lykon Well, I have an extension for WebUI that supports .pt but not .safetensors. Some guys say that it is the solution.
@Lykon , however, if you share the AUTO1111 commit SHA which work for you, it will also be a great option!
@NickKolok I'm 148 commits behind, SHA 7a14c8ab45da8a681792a6331d48a88dd684a0a9
I confirm working on 7a14c8ab45da8a681792a6331d48a88dd684a0a9 , thank you very much!
What "\" are for?
in training some booru tags have "(" and ")", but those have a meaning when prompting (they're weights). The "\" in front is a way to escape them so that they're read as "(" and ")" and not weights by the generator.
Details
Files
ghibli_style_offset.safetensors
Mirrors
ghibli_style_offset.safetensors
GhibliStyle.safetensors
studioGhibliStyle_offset.safetensors
style_ghibli.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
studioGhibliStyle_offset.safetensors
ghiblistyle.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
81c5adfd-3dc1-4718-aeb9-35e3c9413afa.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
stdghbllr.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
画风LoRA:GhibliStyle.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
studioGhibliStyle_offset.safetensors
ghibli_style_offset.safetensors
ghibli_style_offset.safetensors
studioghibli.safetensors










