Klein 9B lcs consistency lora 20260415
RunningHub:
Lora:
https://www.runninghub.ai/model/public/2044762492517228546?inviteCode=rh-v1279
Online Workflow:
https://www.runninghub.ai/post/2016109710943981570/?inviteCode=rh-v1279
Klein 9B consist lcs preivew 20260328
preview version of lcs training method.
Further version is under development
Klein 4B Consistency Lora
This lora inspired by ByteDance Heilos Easy Anti-Drifting method.
I implemented Frame-Aware Corrupt (Reference Latent Corrupt) latent and Color Statistics Loss.
In additionally, I use frequence split dataset which created by converting an image into frequence domain and split it into high freq image and low freq image.
Reference: low freq image, high freq image (0.8 dropout rate on high freq image)
Target: clean image
lr: 2e-4
scheduler: cosine
optimizer: adamw8bit
steps: 6000
Suggested Prompt:
{edit prompt}. Transform the image to realistic photograph. add realistic details to the corrupted image. restore high frequence details from the corrupted image.
Suggested Strength:
0.5-0.7
Trained on 4B based. This lora aims to preserve image consistence across multiple input images. Control the lora via lora strength.
More strength means more consistence but it would also hurt edit abilities.
Different image might has different optimal lora strength.
Running Hub
Flux2 Klein 4B一致性lora对比 runninghub.ai/post/2032812180667633666/?inviteCode=rh-v1279
Flux2 Klein 4B一致性lora 不偏色 不偏移 runninghub.ai/post/2032817113190113281/?inviteCode=rh-v1279
Flux2 Klein 9B Consist Lora
HuggingFace:
https://huggingface.co/lrzjason/Consistance_Edit_Lora
Klein 9B Consis Lora
Suggested Prompt:
restore image details
Flux2 Klein 9B Consis Lora
Trained on 9B based. This lora aims to preserve image consistence across multiple input images. Control the lora via lora strength.
Suggested strength: 0.2~1.5
Use with any prompts.
More strength means more consistence but it would also hurt edit abilities.
Different image might has different optimal lora strength.
RH:
https://www.runninghub.ai/post/2016109710943981570/?inviteCode=rh-v1279
======================QE2511================================
RH:
https://www.runninghub.ai/model/public/2010085010870640641?inviteCode=rh-v1279
Custom_node:
https://github.com/lrzjason/Comfyui-QwenEditUtils
QE2511 Alpha is trained on QwenEdit 2511.
As same as previous lora, this lora helps to maintain image consistence.
The lora is trained using nf4 qlora.
V2 lora is trained for QwenEditPlus aka QwenImage Edit (2509)
It is recommanded to use with strength between 0.5 ~1.0 for multiple images
0~0.5 for single image
It needs to use with workflow v4.0 https://civarchive.com/models/1939540
RH workflow:
QwenEdit Consistence Edit workflow v4.0
Experience link: https://www.runninghub.ai/post/1965033238311915522/?inviteCode=rh-v1279
QwenEdit Consistence Edit workflow v2.0
Solved pixels shift issue and keep qwenvl encode image ability.
RH workflow:
QwenEdit Consistence Edit workflow v2.0
Experience link: https://www.runninghub.ai/post/1965033238311915522/?inviteCode=rh-v1279
Trained with no ref image into qwenvl.
This lora typical to test the consistency with kontext like workflow.
It is suggested to use 0.45~0.5 lora stregth
Workflow:
https://civarchive.com/models/1939540/qwenedit-consistance-edit-workflow
RH workflow:
It's extremely fun and I highly recommend it to you!
Workflow: QwenEdit Consistence Edit workflow
Experience link: https://www.runninghub.ai/post/1965033238311915522/?inviteCode=rh-v1279
Description
FAQ
Comments (48)
Works well. Thank you.
fantastic lora with the node, works as described
the overlay example definetily looks good, i'll give a try
does this work for other features or poses that arent cloth or clothing related? if so is there something I am missing to accomplish that
You could adjust the lora weight for consistency. Higher lora weight means smaller shift, lower means more editing ability
other features, yes! I tested it with "put things on that" prompts and it worked very well
Working with new 2509?
v2.0 is trained on 2509
@xiaozhijason perfect. Thank you for your service.
niceeeeeeee, i've actually tried it today after being disappointed with qwen edit and man... THIS LORA WORKS! The images got instatly better, thanks a lot!
can you create a wrokflow that goes with swarm? these JSONs dont load properly into Swarm's comfy back end and i'm not a node person.
No plan for it
When using with Qwen-Image-Edit-Rapid-AIO, a grid appears on the generated image. What could be the problem?
This lora is trained on qwen edit 2509 and only tested on qwen edit 2509. If custom has issue with this model, you might ask the author of the custom model.
Noticing same issue. Any luck?
Qwen-Image-Edit-Rapid-AIO is based on 2509...
maybe try v5.1 as he added some fp8 lightning to possibly resolve the issue.
or
one of my GGUF's see quantization on Phr00ts repo
@wardkellphelan312 I went with v5.1 that seems to have helped. I also removed lightning loras, qwen union and qwen pose lora (in my case) as those seem to now be part of that ckpt. So only load v5.1 that has everything baked into it.
i tryed without the lora lightning, and it work better, and it work as fast than with it
What is the recommended prompt for this to work properly?
No prompt required. Adjust lora strength to adjust the effect.
At the risk of using a worn-out phrase: This Lora is a game-changer! Had remarkable success with Qwen image edit 2509_Q5_K_M on an old GTX 1070; I'm finally able to rotate a character and keep consistent body and face. I don't know what voodoo you pulled with this lora but I notice excellent results on an 8 step lightning lora at just the 2nd iteration (25%).
Great Lora! It works perfect! Thank you!
Hello, this is great! Thank you for your work. What is VL Encode?
Qwen model is using qwenvl2.5 as text encoder. qwenvl2.5 able to accept image as input and generate condition based prompt and image.
Hello, I'm debugging this LoRA using diffusers. I found that those layer names for image stream is NOT in diffusers format, hence they aren't loaded by diffusers actually (e.g., ...attn.to_q.lora.down.weight, the correct name might be ...attn.to_q.lora_A.weight).
However, only under this strange setting does this LoRA work like a charm. I manually re-named those layers to the diffusers format ( lora.down -> lora_A, lora.up -> lora_B) but got very bad results.
Any idea of what is going on here?
No idea, it should be identical by remapping the keys.
did you manage to solve it? if so, how?
Is this face consistency lora or cloth consistency or what am I missing?
You're going to have to try it to see for yourself. It's good for swapping clothing, making it look more natural in the scene while keeping close to the original proportions and skin.
Works great, faces, clothes and bodies are all as they should be.
Wow. This is such a game changer. Literally super accurate and without problems even on lower VRAM such as 12Gb. Thank you.
ooooo 12 gb sooooo lowwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
@Thatonecreator bro i am acutally using this on my 6 gb vram and he said 16gb vram is low lol
@kumarkishank959811 Lmao these people don't understand the difficulties we face
i only have 12 gb ram as well but have troubles running this, which qwen model are you using it with?
@falerenio Qwen-Image-Edit-2509-Q4_K_M.gguf works ok for me. I haven't tried the newer models yet or the new workflow for the new models. are you getting OOM? What graphics card do you have? I am running fine on RTX 3060 and 32gb RAM.
For the past month I've been trying to figure out how best to generate datasets from reference images to train LoRa's, rotating the camera around the character etc.. and I've been struggling with character likeness, having to generate tons of batches to sort through for good seeds. Sometimes sorting through hundreds of images to end up with only half a dozen.
I Tried so many different LoRa's, tons of different prompts, testing different settings Shift/CFGNorm/CFG/Steps/Samplers/Lighting/NoLightning, many different complicated workflows with control nets, face recognition, dozens of fancy custom nodes. You name it I've tried it.
Someone mentioned this LoRa on a reddit thread and I figured I might as well give it a try and for some reason this simple little LoRa just works. With a simple workflow and basic prompts it maintains the likeness of the character better than literally anything else I've tried. I'm actually flabbergasted at how good this works.
This thing is incredible. Great job xiaozhijason
大佬,请问我使用了提到的工作流和这个lora后,生成的图永远是第一张参考图,这是为什么,检查工作流是完全复刻的呀
降低lora强度,lora提供一致性,强度过高会导致修改能力变弱
@xiaozhijason 感谢!
hi brother it's really urgent i can't know why in some picture if i enable cons edit v2 with a lets say 0.3 weight it's work ( close shot) and when the girl or guy is far away it doesn't work i need to disable it. by the way if you can check your wechat i've added you im professional and doing business i need to have you quick, thx.🙏
The lora has its limitations. Not much far away training image. Please share who are you and why would you add me in wechat.
Are you planning on doing a 2511 version?
V2 looks to be working well with 2511, for me at least.
Updated
@Peticree435 But not good as 2509...I tested with FP16 and FP8
2511 i am using this & its just working
Details
Files
consistence_edit_v2.safetensors
Mirrors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
qwen_consistency_v2_lora.safetensors
consistence_edit_v2.safetensors
qwen_consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
2509_consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
qwen_consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
consistence_edit_v2.safetensors
qwen_consistence_edit_v2.safetensors

