Waifu Diffusion 1.4 Anime Release Notes

Download Pages

HuggingFace Diffusers: https://huggingface.co/hakurei/waifu-diffusionPickled Models: https://huggingface.co/hakurei/waifu-diffusion-v1-4

Table of Contents

Model OverviewTraining ProcessPrompting & Quality AugmentingLicenseSample GenerationsTeam Members and Acknowledgements

Model Overview

The Waifu Diffusion 1.4 Anime model is a Stable Diffusion v2 model that has been finetuned from Stable Diffusion v2.1 Base.

The data used for finetuning Waifu Diffusion 1.4 Anime was 5,468,025 text-image samples that had been downloaded through an image board that provides high-quality tagging and original sources to the artworks themselves that are uploaded to the site.

Within the HuggingFace Waifu Diffusion 1.4 Repository are various models used within the production of the model:

Waifu Diffusion 1.4 Anime Epoch 1: A test model made to properly ensure that the training setup works.Waifu Diffusion 1.4 Anime Inference Config: A file included to allow for inference with Automatic's WebUI and with the original Stable Diffusion codebase.

Prompting

During dataset processing, the following quality modifiers were added to samples depending on the score of the post:

Quality Modifier Score Criterion

masterpiece>150

best quality100-150

high quality75-100

medium quality25-75

low quality-5-0

worst quality<-5

Additionally, certain metadata were also added in the form of rating modifiers.

Rating Modifiers Criterion

safe, Samples that are safe for work.

questionable, Samples that include risque visuals which are probably not safe for work.

nsfw, Sexually explicit or graphic material that you should not view while your boss is looking over your shoulder.

deleted, Samples that were marked for deletion.

Based off of the above modifiers, an ideal negative prompt to guide the model towards high aesthetic generations would look like:

worst quality, low quality, medium quality, deleted, lowres, comic, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry

And, the following should also be prepended to prompts to get high aesthetic results:

masterpiece, best quality, high quality, absurdres

License

The Waifu Diffusion 1.4 Weights have been released under the CreativeML Open RAIL-M License.