The strength of Lora is recommended to be around 1.2.

It's not stable. If you adjust the prompts, I think you can do without Lola.