You must reduce the Lora's strength. In general, I recommend reducing it to 0.50. But 0.50-0.70 is worth experimenting with depending on the checkpoint and prompt being used.

Recommended Settings:

Checkpoint: Natural Sin RC1 VAE

Lora Strength: 0.50

CFG: 2-4

Want to request a celebrity? Commission me.

General Recommendations:

Use ADetailer to improve faces when subject is further away. See this video for explanation.

Easynegative can be an easy way to improve image quality.