I did some tests with my models and it clearly damages the style a bit. For best use, for now, you should use weight 0.4 or less. Sometimes the 'eye pupil' wont appear in the shirt.

This would be a very nice Lora if trained with 20 or more pictures with different characters, poses and backgrounds with the shirt, putting unicque tags like shirt_eyes, shirt_green_eyes, shirt_black_pupils, and then the main trigger/tag, that could be emoshirt or something like that, in order for the AI to keep a good track of it.