Step 1: Use lora weight below 0.5. The lower the weight, the more flexible it is.

Step 2: When retouching the face, set the Lora Weight for the character to 1.