This workflow uses SAM to invert the colors of the character to be replaced. By doing so, it makes character replacement significantly more consistent that Minimax H3 alone.<h1 id="how-to-use-it">How to use it</h1>You must<ol><li>(v2,v3 or v4) Install <a target="_blank" rel="ugc" href="https://github.com/kijai/ComfyUI-SolAttn_triton">https://github.com/kijai/ComfyUI-SolAttn_triton</a> if you want the speedup.</li><li>(v3 or v4) Install <a target="_blank" rel="ugc" href="https://github.com/1038lab/ComfyUI-QwenVL">https://github.com/1038lab/ComfyUI-QwenVL</a> for QwenVL video to text description.</li><li>(v4 only) Download the custom node h3-split-video-inputs.zip. You can download this one in the same menu as the workflow.</li><li>(v1 only) Change the text prompt to describe both the scenario and the subject. Your goal is that Minimax H3 reproduces the original video as similar as possible.</li><li>Change the video and the picture, and make sure to change as well the resolution to match the original video.</li><li>(Optional, v2) change the SAM prompt until it masks only the subject to replace.</li><li>(Optional, v3) change the hint given to the Qwen node.</li></ol><h3 id="why-sam-and-masking-with-h3">Why SAM and masking with H3</h3>When using H3, it seems that the model will either recreate the original video as it is, without changing the subject at all (follows the &lt;Video 1&gt; too literally), or it will create a totally new video (follows the &lt;Picture 1&gt; too literally).However, when inverting the color of the subject in the video, H3 is forced to produce a new video because the subject looks weird. So it can't follow the &lt;Video 1&gt; too literally anymore, otherwise it would produce a video with inverted colors.<h2 id="custom-node">Custom node</h2>The custom node used on V4 feeds different perturbed subject videos to the Qwen and the VAE parts of the model. This has been tested in many different scenarios and it has good accuracy.

Minimax H3 character replacement

Uses a custom node to perturbe the subject differently in the VAE and the Qwen inputs.

Files with SHA256: ad2ff7762b24c6539eb4cfd05180162f17ab124f9e4b6cbd9ac65ef94cfc4f5c