Harry Potter Characters Pack LoRA 💥
This LoRA is trained on a scene image dataset from the Harry Potter series, from The Philosopher's Stone to The Deathly Hallows. The idea is I want to have a model that can remember all the main characters and able to recognize the different between 1st year characters and 7th year characters. However, the result is not so successful. I still want to share some part of this project.
Usage Tips:
This version only with my PrincessRealitic Ponly model. The version that work with Pony Diffusion V6 XL or other Pony-based models are not good (still in development).
Trigger Words for Characters:
harry potter,hermione granger,ron weasley,draco malfoy,Some more Trigger Words (that used but not show well result)
ginny weasley,neville longbottom,dudley dursley,cho chang,cedric diggory,fleur delacour,viktor krum,luna lovegood,george fed weasley,The model is also trained with year Trigger Words but not seem to follow the tags.:
year_1,year_2,year_3,year_4,year_5,year_6,year_7,
Sampling Tips: For best results, I recommend using this model with ADetailer
Description
FAQ
Comments (5)
Any plans to release separate models of each character? :)
Not yet, not soon. I still have to find some good parameter setting for the training. Before moving to any next project.
A pity you say this project didnt work out well, your models are usually excellent.
Any idea what went wrong? especially with your idea of year tags (great idea, more people should try it!) -- maybe SDXL can't differentiate between years since the faces are too similar?
My work are not usually excellent. There are a lot of bad works that I don't want to share. In the case of this model, there are people DM to me that they would like to have harry potter's lora which I have.
I don't know what went wrong. Maybe the size of dataset is too small for the task. Recently, I have tried to reduce the training cost so I can test more ideas. This project as well also have a limit in dataset size. I have remove some hogwarts professors and death eaters (also fantastic beasts characters). I will come back to this project soon. Maybe I'll try only harry from different years. I also want to know what wrong.
@titansteng OK, thanks for clarifying.
Keep up the good work, so much of your output is very creative and very useful, I really enjoy it.