It's hard to describe the reasons for releasing it
I just want to make models for use in face restore theAfter testing theIn testing baIn testing the base While testing the base model, I appended the previously trained female facial expression lora to the official Refiner model using comfyui's ModelMergeAdd. It turned out that it produced some changes.
I recall that not long after sdxl was released, the refiner feature was abandoned by everyone in the face of sniping from the many excellent basemodels.
So I spent some time putting together the bare parts reg images I used in creating the porn lora, trained a lora, and added it to the original refiner model.
Tests afterward showed a lack of positivity in doing this, but I wanted to put it here anyway, maybe it's just because I have so few training images, maybe there's a master out there who can make the refiner model work again?
Creating Methods:
Official basemodelV1.0 + sdxl-wrong-lora (STRENGTH: -0.5)
LyCORIS was trained using nude images on the model from step 1 and merged to the checkpoints. *Includes full body, half body, close-up of both men and women
Merge the previously trained facial expression Lora into the checkpoints from step 2. *The dataset has only females and the age range of the characters is very narrow
original refiner model + (Checkpoints for step 3 - Official basemodelV1.0). *clip-G has 40% from Checkpoints for step 3
The example images are the tests I performed, the non-refiner, the original refiner, and the refiner after appending 2 Lora's. The images can be dragged into comfyUI to see the test workflow.
The refiner's ascore function is still valid in the test.
*Turn on return_with_leftover_noise in the 1st KSampler of comfyUI to verify the Refiner function. I'm not sure what the normal flow of Refiner in auto1111 looks like.
Again: personally I don't think it makes much sense, download with caution.
Description
There will be no further progress.
FAQ
Comments (5)
Yep, less people use ReFiner, it not popular.
I don't use it either. Merely curious about its functionality.
Hey that's cool, thanks for the effort. I sometimes still use the refiner since you can get slightly sharper images / better details. It kind of destroyed body parts so this is great.
Because the original refiner model doesn't have the nsfw part of the training data in it I guess. So it will blur out certain bare parts.
But this model doesn't solve that kind of problem either. Maybe someone training with a larger dataset would work well.
@suede2031691 I do think it's a good idea to try and train the refiner, thanks for your effort
