It works best if the LoRA number is below 1.0 to prevent the more wonky elements of the sample pics, as well as negative prompts.