The main goal of this ComfyUI workflow is to create two images: one with an anime look, and one with a realistic look. The two images should look relatively similar, and a video interpolating from one to the other will be produced at the end.
The workflow itself features multiple latent techniques such as:
Noise injection
Latent upscale
Face detailer
...but all of these are optional, and the core feature is that, for the base generation (the very first group of KSamplers), the denoising process will branch from the anime model to the realistic model after a given amount of steps.
Then, both images branch off for the later upscaling processes and face detailer.
The workflow allows to specify independent values for each image:
LoRa stack
Guidance scale
Prompts (suffixes and prefixes for simplicity)
With little modification prompts and base models could be entirely different, if you truly need it.
The LoRa stack for the realistic image is removing LoRas during the upscaling process as I've experienced the infamous "FLUX lines" in many of them.
The .zip file contains the JSON workflow as well as all the raw pngs, so you can easily drag-n-drop them in ComfyUI to recreate the images shared as examples.
Description
FAQ
Comments (6)
What are the loras used in the workflow?
For the realistic image I used the following loras:
https://civitai.com/models/970862
https://civitai.com/models/677200
https://civitai.com/models/1157318
https://civitai.com/models/631986
For the anime/cartoonish image I used the following loras:
https://civitai.com/models/723187
https://civitai.com/models/650185
https://civitai.com/models/1220524
https://civitai.com/models/850634
https://civitai.com/models/979959
No Control net but... theres a lot in there :D
is this possible with sdxl?
I'm sure it is! Would require a few tweaks to the workflow.
could you please consider altering this workflow to allow for img2img? i just need to convert to photo realism









