ControlNet-LLLite QRPattern
Warning: Trained using a experimental implementation of ControlNet-LLLite
Conditioning only 25% of the pixels closest to black and the 25% closest to white.
Notes
* Compatible with default controlnet extension in automatic1111
* Comfyui need this custom node https://github.com/kohya-ss/ControlNet-LLLite-ComfyUI
* The actual QR part is improved in relation to the optical pattern version, but it is still a work in progress
IMPORTANT:
Try to generate a lot of images and adjust the parameters. The example parameters are the ones used in most images here, many images require different values.
Example parameters
* Sdxl Model: realvisxlV20
* Preprocessor: none
* ContolNetModel: controllllite_v01256512e_sdxl_qrpattern
* Control Weight: 1
* Starting Control Step: 0
* Ending Control Step 0.75
* Resolution: 1024x1024
----
QR Pattern and QR Pattern sdxl were created as free community resources by an Argentinian university student. Training AI models requires money, which can be challenging in Argentina's economy.
If you find these models helpful and would like to empower an enthusiastic community member to keep creating free open models, I humbly welcome any support you can offer through ko-fi here
Description
FAQ
Comments (14)
I bet that in one month there will be someone using this to generate Bad Apple
i went through all the images before reading the entire description section of the post, and now i'm slightly embarrassed
I cannot seem to get this to work in A1111. The only thing it makes is essentially the word/design superimposed over an image.
@drunkoctopus SDXL has the problem that it knows how words look like, and always tries to keep them, it is a bit tricky to use images with words, try to adjust the parameters and generate a lot of images
hello, is this really working, I tried it in comfy and always getting errors. can someone post a png with a basic working workflow ?
@jeykech Sure
Works for me, my own samples and some from this page
i cant get it to work
Are you using the forge webui? currently its only working on the original automatic1111 and comfy
@Nacholmo yes. can you recommend a way to get it to work with forge webui?
@yofoton174609 I probably have to retrain the model from ground, since when I trained the model LLLite-controlnet code was still very experimental. Maybe this weekend I would if I don't find a fix
My other model is an original controlnet and works in the current forge webui
https://civitai.com/models/161132/sdxl-controlnet-opticalpattern-optical-illusions
@Nacholmo thanks. let us know if you also manage to make the qr "extra scannable" . Because all the other qr code models give unscannable qr codes.
Could you please tell me an instruction on how to use it? I can't get this control net to start
Cant get it working, downoaded it just now and the ComfyUi Controlnet loader claims the .safetensors file is not a valid Controlnet ?!