Update: SDXL 1.0 version here, with additional ability to generate Kanon with glasses and training outfit.
Trained using around 150 anime screenshots from season 1 and season 2. 20-30 images are chosen from sideway angles (booru tag from side). This is important, as previous models I trained for Kanon as well as other characters lacked the ability to generate sideway images.
Activation tag: shibuya kanon
To generate school uniform: student uniform, gray dress, red ribbon, neck ribbon, pinafore dress, white shirt
To generate glasses: glasses. For v2, include bangs, hair between eyes as well (the model will generate her wearing glasses without bangs if not prompted)
Notes for v2
This version produces images extremely close to the anime art style. Most importantly, it rarely distorts her eyes. The key to this might be using a high repeat number and low learning rate, as well as a large enough LoRA capacity (I used 32/16). See changelog (About this version section on the left pane) for more details regarding the training parameters.
Model and ratio:
Meina_Hentai*: around 0.6-0.7. I recommend using this since it is what the LoRA has been fine-tuned from. Do not get fooled by the name, it is actually a good SFW model
Anything v4.5, AOMv3: similar to the above. Also precisely describes Kanon, though generated images have high saturation
Demo images did not went through any highres upscaler.
Notes for v1
Model and ratio:
Anything v4.5: use a LoRA ratio of around 0.6-0.8
Corneos7thHeavenMix: ratio about 0.7-0.8. Good for generating anime style art
AOM3A1: around 0.6. Might confuse left and right bangs if generate sideway images
AOM3A1 also has the tendency to change Kanon's hairstyle to hair bun, hair tie, or add random hair bow, ornament, etc. Consider adding those to the negative prompt if you don't want them to appear in your images.
Comparing v2 and v1
Left: v1, right: v2. All images are generated with Meina_Hentai and AOMv3 VAE
Description
Trained in 150 anime screencaps from season 1 and season 2
Finetuned from NovelAI (anime-final-pruned-fp16)
Parameters:
[additional_network_arguments]
unet_lr = 0.0005
text_encoder_lr = 0.0001
network_dim = 16
network_alpha = 8
network_module = "networks.lora"
[optimizer_arguments]
learning_rate = 0.0005
lr_scheduler = "cosine_with_restarts"
lr_scheduler_num_cycles = 3
lr_warmup_steps = 130
optimizer_type = "AdamW8bit"
[training_arguments]
max_train_epochs = 10
save_every_n_epochs = 5
train_batch_size = 2
clip_skip = 2
seed = 42
max_token_length = 225
xformers = true
lowram = true
max_data_loader_n_workers = 8
persistent_data_loader_workers = true
save_precision = "fp16"
mixed_precision = "fp16"
output_dir = "/content/drive/MyDrive/lora_training/output/shibukano"
logging_dir = "/content/drive/MyDrive/lora_training/log"
output_name = "shibukano"
log_prefix = "shibukano"
save_state = false
[model_arguments]
pretrained_model_name_or_path = "/content/animefull-final-pruned-fp16.safetensors"
[saving_arguments]
save_model_as = "safetensors"
[dreambooth_arguments]
prior_loss_weight = 1.0
[dataset_arguments]
cache_latents = trueFAQ
Comments (1)
You posted this Lora as a checkpoint
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.