It's a little unstable, so I probably need to make another in the future, but as long as you prompt the full set of clothes it seems to make decent results. The red collar around his neck usually comes out as a belt, so inpainting is adviced, recommended strength also depends on the model but usually should be from 0.7 to 0.9 at most. 1.0 strenght works but makes the backgrounds very unflexible.

You might also want to put some extra negatives to avoid NSFW depending on the model again.