Instant LoRA
Legacy Lore (for the Original Revamp Version):
Original Concept by AloeVera_Purple
(No longer on CivitAI, good luck wherever the winds of change may take you!)
In the words of its original creator: "This workflow will take your input images, distribute them into the two different IPAdapter models, [Edit: Only one for Flux.1 because there is no Face IPAdapter yet that works on Flux.] with different timesteps (distribution in time basically), and shift your results, like a LORA would... but in this case, you don't have to train anything. It has likeness scores up to 95%. + With the right settings, it can be incredibly accurate. Unfortunately, there are no "Golden" settings that work for all. You'll have to tweak things a little bit, up and down. See what works best for you."
Information:
From now on all information pertaining to the versions can be found in the version history section at the right side of the screen (Just below the download section). This will contain a list of changes and/or Installation Steps for the Workflow and the Files (If you downloaded those).
How to use:
The general usage of the workflow is pretty simple. Just add up to 6 images of your choice to the Image Loaders (Bypass the ones you want to leave empty), type up your prompt and send it to "Generate". The IPAdapter will combine the Images into a makeshift LoRA and use the style and overall color scheme on the new generation.
The Batch Maker Node scales with additional Images so feel free to add as many as you want. Keep in mind that more Images means longer wait time for IPAdapter to process the images into the Makeshift LoRA.
Works in Progress and Suggestions
Work is being done to add Regional Prompting to the Workflow. At the moment I'm figuring out how to do add this function into my "Negative Prompt & HiRes.Fix" workflow. once this all works accordingly it'll be added to the Instant LoRA workflow as well!
Found Issue: Tying in the Regional Prompting is not a problem but it seems the IPadapter for Flux doesn't like playing together with it. The Workflow seems to work (no errors during execution of the workflow) but the output doesn't adhere to the regional mask prompts. Will investigate further. There are no errors thus in theory it should work.
Adding a Weight or Ratio system to the Images so you can choose how much it'll influence the generated picture.
~ Suggested by angryskyFound Issue: While it is possible to tie weight markers to each image this will at the moment require the Batch Loader to be turned into a Model > Model Feed system and for Flux.1 this will result into an extreme long generation time even on higher end Consumer GPUs. (I will do some more research but at the moment while possible the extended generation time makes this practically non-viable.)
Description
Changes:
Finally there is Flux.1 Functionality.
I have chosen for the GGUF version of Flux.1 so more people can play around with the Workflow as each can choose their own quantized version that works best for him/her.
The Quantized GGUF files can be found at:
Chose whichever filesize will work for your rig.
Setup:
Install ComfyUI Manager by ltdrdata ( https://github.com/ltdrdata/ComfyUI-Manager )
This will make sure you can easily install the missing nodes you'll need for this Workflow to function.
Download the *.zip file containing the Workflow.
A separate Download with all the needed files is also available.
Launch ComfyUI and Load the Workflow.
Use Manager to install the Missing Nodes and then restart ComfyUI (there should be no Red Colored Nodes after this step)
Put the Extra Files into the Correct Folders
CLIP-ViT-Large-patch14.safetensors --> Copy this into your ComfyUI\models\clip_vision Folder
flux-ip-adapter-v2.safetensors --> Copy this into your ComfyUI\xlabs\ipadapters Folder
If at this point you don't have these folders in the Model folder it's perfectly okay to create them.
The 2 CLIP files need to go into the ComfyUI\models\clip Folder
I highly suggest to use the LongCLIP-L file if your CPU and GPU can handle it for better results. If not the normal clip_l is perfectly acceptable.
I have Provided 4 upscale_models in the *.zip file these should go into the ComfyUI\models\upscale_models Folder.
FAQ
Comments (7)
Thank you for making. I am trying the new Flux version with ip adapter v2. I am not getting a good likeness from source photos and the image output is not near my prompt. Is this your experience with the Flux IP Adapter? Do you change from 1.0 strength in certain situations?
Could use a ratio between images, so you could set how much each influences the output. Slow on my 3060, but thanks for your efforts.
it takes ages to install missing nodes (for Flux instant lora), can I install them manually without comfy manager?
I downloaded the package with the files and installed it correctly. My ComfyUI is up to date, I checked for missing modules in Comfy Manager, searched through the ComfyUI issues, on Reddit, and even asked ChatGPT and Grok, but I have no idea how to solve this. I couldn't find this basic ksampler to install, nor anything similar that has a model, positive and negative inputs, with a latent output. Any idea what this is?
Missing Node Types When loading the graph, the following node types were not found SDXL Resolutions (JPS) (In group node 'workflow>Unified IPAdapter Sampler') workflow>Unified IPAdapter Sampler invalid prompt: {'type': 'invalid_prompt', 'message': 'Cannot execute because a node is missing the class_type property.', 'details': "Node ID '#24'", 'extra_info': {}}It doesn't work anymore. There are still multiple missing nodes, even after installing them via Node Manager.
Doesn't work due to the "Unified KSampler" not existing anywhere. Not on github, checked google, checked Bing. No where does it exist(any more)
Looks like we don't have an active mirror for this file right now.
CivArchive is a community-maintained index — we catalog mirrors that volunteers upload to HuggingFace, torrents, and other public hosts. Looks like no one has uploaded a copy of this file yet.
Some files do get recovered over time through contributions. If you're looking for this one, feel free to ask in Discord, or help preserve it if you have a copy.