I know someone made one before with only Lora.
This one use Locon!
This one use Locon!
This one use Locon!
I just use 8bit adam to train it, with all images i can find.
Actually I try Lion and 8bit-adam several times, this seems fine, not quite overfit.
Base is nai, my samples are from AOM2.
I only try 0.6~1, seems fine on AOM2.
Samples are picked, but I think most of images I got are still Ok, not too hard to find some good ones.
I did not try with NSFW tags, but you can try by yourself.
Description
Some
8bit Adam, with Locon.
768,768 with bs=2
$lr = "1e-4"
$unet_lr = "1e-4"
$text_encoder_lr = "1e-5"
$lr_scheduler = "cosine_with_restarts"
$lr_restart_cycles = 1
$conv_dim = 4
$conv_alpha = 4
$network_dim = 8
$network_alpha = 8
no reg
FAQ
Comments (6)
What is the advantage of Locon?
finetune more layer (actually include conv), so easier to learn styles
That is great news, where can I learn more about it?
@sekoseko https://github.com/kohya-ss/sd-scripts I use this script to train locon, simple and effective. But actually I do not really understand this theoretically.
Thank you
@ada_ALS thank you too
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.