The Lora is weak. I don't know why that is, to be honest.

It just got worse and worse, the longer the training went on.

I highly recommend using a fine tuned model + a strength of 0.7~