An experimental version of IP-Adapter-FaceID: we use face ID embedding from a face recognition model instead of CLIP image embedding, additionally, we use LoRA to improve ID consistency. IP-Adapter-FaceID can generate various style images conditioned on a face with only text prompts.
Description
FAQ
Comments (20)
What's the difference between the two 1.5 models?
it works for XL, author h94 said XL version is experimental i.e. portrait is not available, face portrait for now is 1.5 exclusive
@trytensor That doesn't answer the question: "What's the difference between the two 1.5 models?"
Of course SDXL version is going to differ, but when you have 2 1.5 options, one does wonder what the difference between those are.
work on Fooocus?
@Derjyn ah my bad, sorry didn't read the 1.5 since I'm using XL!
the difference is listed on h94 model card
1.5 portrait vs 1.5 v2, the portrait one is for passport styled facial profile, while the v2 one is more like faceswapper, general use and face orientation
now one does wonder what is the difference between non-portrait v1 and v2 (both 1.5) or the non-portrait v2 1.5 vs the experimental XL, for these I haven't tested yet.
Does it need the Lora?
yess
@Gametesterbuz where lora
What preprocessor for SDXL? None of which I have installed work
I have another "ip-adapter-faceid-plusv2_sdxl.bin" it works fine with the preprocessor
it uses same preprocessor
@Gametesterbuz I'm using the other one just fine and then with this one I got
2024-02-12 17:22:31,772 - ControlNet - ERROR - Invalid pair of IP-Adapter preprocessor(ip-adapter_face_id_plus) and model(ipAdapterFaceid_faceidPlusv2Sdxl [187cb962]).
Please follow following pairing logic:
{
"ip-adapter_clip_sdxl": lambda model: "faceid" not in model and "vit" not in model,
"ip-adapter_clip_sdxl_plus_vith": lambda model: "faceid" not in model and "vit" in model,
"ip-adapter_clip_sd15": lambda model: "faceid" not in model,
"ip-adapter_face_id": lambda model: "faceid" in model and "plus" not in model,
"ip-adapter_face_id_plus": lambda model: "faceid" in model and "plus" in model,
}
@chabonmental I fixed this by changing the name of the .bin from "ipAdapterFaceid_faceidPlusv2Sd15" to "ipAdapterFaceid_faceidplusv2Sd15". It appears that the matching process is case sensitive
@rajihov168887 hey it seems that was it, thanks, it worked after changing the name without caps
@Gametesterbuz where can i find this?
Just go here: https://huggingface.co/h94/IP-Adapter-FaceID
You don't look like xiaohu.....
Which folder do I put this in?
create a /ipadapter subfolder in /models if I'm correct
How to convert bin format to safetensors format
Over a year later, and you still haven't posted any form of instructions or details about this whatsoever? Is this even your work? Why bother uploading at all?
Details
Files
ipAdapterFaceid_faceidPlusv2Sd15.bin
Mirrors
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ipAdapterFaceid_faceidPlusv2Sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
ip-adapter-faceid-plusv2_sd15.bin
