Perhaps due to the art style, Anima sometimes perceives Joe Yabuki as a female character. Consequently, the face tends to shift to an overly "masculine" look during close-up shots.

Although I attempted to force an overfit to resolve this, the issue persists to some degree.

Depending on your needs, please try increasing the LoRA weight beyond 1 or omitting "1boy" from the prompt.