This LoRA was created using frames from the Soviet film "The Adventures of Buratino" (1975), an adaptation of the Soviet version of Carlo Collodi's book "The Adventures of Pinocchio".
At first, I made a version featuring only one character - Buratino. However, I decided to test whether it would be possible to create a LoRA for multiple characters simultaneously. It turned out to be quite feasible! This LoRA can depict four characters from the film: the boy with the long nose - Buratino, the girl with blue hair named Malvina, the red-haired woman - Alisa, and the man with dark glasses and cat-like whiskers - Bazilio.
An important condition for proper functioning is providing an accurate description of the character, including their name and details.
Buratino:
A boy Buratino with curly blond hair and a long, pointed nose. He wears a red-and-white striped cap with a pom-pom at the end and a yellow shirt.Malvina:
A girl Malvina with curly light-blue hair and a large white bow. She is dressed in a white dress.Alisa:
A woman Alisa with red hair who wears a hat with feathers and a fur coat.Bazilio:
A man Bazilio who wears a hat and round sunglasses. He has sideburns and cat-like whiskers.I managed to generate a video featuring all four characters simultaneously. However, most of the time, when there are more than two characters, details tend to get mixed up. For instance, you might end up with a blue-haired girl sporting a long nose, sunglasses, and a feathered hat.
The LoRA was trained on horizontal frames, so black bars may appear at the top and bottom of vertical frames. Additionally, in some cases, increasing the LoRA weight to 1.2 can help achieve a closer resemblance of the characters to the original.
Of course, the film featured more characters, and if there is interest in this LoRA, I will try to create a version that includes all the characters from the movie.
Description
FAQ
Comments (6)
lol wtf, this is the last film i would think of recreating.
ну если только на Мальвиночку посмотреть
LoRa's quality is excellent! What trainer did you use? What parameters? Can you share your precious knowledge? I want to train LoRas on other USSR movies
Thank you!
I use diffusion-pipe. 5-10 images per character and 10 images with 2 or 3 characters in frame, fixed resolution 768x512, 50 epochs (4000 steps). All other training settings were left default. It took about 10 hours on 3090.
resolutions = [[768,512]]
enable_ar_bucket = false
frame_buckets = [1]
num_repeats = 5
@Gorro17 "All other training settings were left default" - so you've used LoraRank 32 ?
@77mame832 yes
[adapter]
type = 'lora'
rank = 32
dtype = 'bfloat16'
[optimizer]
type = 'adamw_optimi'
lr = 2e-5
betas = [0.9, 0.99]
weight_decay = 0.01
eps = 1e-8
Pls if you can - try creating LORA for the "Father Frost" (Морозко) movie :)