Consistent Characters with Flux - InfiniteYou [COMFYUI]

Infinite You can used for many things such as face swapping, merging and even new scene variation with consistent characters, it can run in Fp8 and GGUF is available because it used the Flux image Pipeline.

I have provided Example Workflows for Flux Dev (FP16/FP8), Flux Schnell (FP16/FP8) and Shuttle Jaguar GGUF Q8_0.
https://github.com/MushroomFleet/DJZ-Workflows/tree/main/Foda_Flux/InfiniteYou
https://civitai.com/models/1431218 <- here on Civit

- SIM (similarity) (controlnet.safetensors + model.bin)
- AES (aesthetic) (controlnet.safetensors + model.bin)

Custom Node: (comfyui)
https://github.com/ZenAI-Vietnam/ComfyUI_InfiniteYou

git clone inside custom_nodes and run the requirements
for portable comfyui installations use my install-portable.bat (windows)

(https://github.com/MushroomFleet/DJZ-Nodes/blob/main/install-portable.bat)

You Will Need:

InfiniteYou Controlnet

https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/sim_stage1_control_net/sim_stage1_control_net.safetensors

https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/aes_stage2_control_net/aes_stage2_control.safetensors

place inside ComfyUI/models/control_net

InifiniteYou Weights

https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/aes_stage2_control_net/aes_stage2_img_proj.bin

https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/sim_stage1_control_net/sim_stage1_img_proj.bin

place inside ComfyUI/models/InfiniteYou

InsightFace weights:

https://huggingface.co/MonsterMMORPG/tools/resolve/main/antelopev2.zip

extract and place inside: ComfyUI/models/insightface/models/antelopev2/

CLIP + VAE

This used the Flux pipeline, so you will need the Flux VAE and Clip L + T5xxl:

https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp8_e4m3fn.safetensors

https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/clip_l.safetensors

place inside ComfyUI/models/text_encoders/

https://huggingface.co/black-forest-labs/FLUX.1-schnell/resolve/main/ae.safetensors

place inside ComfyUI/models/vae/

I have removed text from the final line of requirements.txt (windows 11),
you may find success if you do the same.

`
insightface

onnxruntime

huggingface_hub

facexlib==0.3.0

numpy==1.26.4

opencv-python==4.11.0.86

onnxruntime-gpu
`

INSIGHTFACE TROUBLESHOOTINGS

Close comfyui when you are doing the following:

I. (For Windows users) If you still cannot build Insightface, do the following:

1. (ComfyUI Portable) From the root folder check the version of Python:
   run CMD and type python_embeded\python.exe -V
   

2. Download prebuilt Insightface package
   for Python 3.10
   for Python 3.11 (if in the previous step you see 3.11)
   for Python 3.12 (if in the previous step you see 3.12)
   and put into ComfyUI root folder if you use ComfyUI Portable
   

3. From the root folder run:

   • (ComfyUI Portable) run CMD
     

4. Then update your PIP:

   • (ComfyUI Portable) python_embeded\python.exe -m pip install -U pip
     

5. Then install Insightface:

   • (ComfyUI Portable)
     
     python_embeded\python.exe -m pip install insightface-0.7.3-cp310-cp310-win_amd64.whl
     (for 3.10)

     
     python_embeded\python.exe -m pip install insightface-0.7.3-cp311-cp311-win_amd64.whl
     (for 3.11)

     
     python_embeded\python.exe -m pip install insightface-0.7.3-cp312-cp312-win_amd64.whl
     (for 3.12)

6. Enjoy! (written by Gourieff https://github.com/Gourieff/ComfyUI-ReActor big thanks!)