My first attempt at fine-tuning an illustrious model using a LoKr. The model has been trained on a set of 6000 high quality images that were captioned with JoyCaption.

The LoKr is still a bit under trained and I recommend using high strengths, but you might want to test that yourself. The base model used to train the LoKr is https://civitai.com/models/1323352/illustrious-ultrareal-6gb which seems to be one of the best photoreal illustrious chekpoints out there as of today.

The basic idea is to use a large LoKr to finetune a model, I originally wanted a larger LoKr, but I messed up the setup and ended up with a smaller set of parameters. In the end that might have been a good thing.

All in all, I am happy with the result, but I do not consider it a perfect product yet. It could have been done better.