ArtiWaifu Diffusion

Although this is the first version of ArtiWaifu Diffusion, it serves as a powerful successor to the Anime Illust Diffusion XL (AIDXL) series of models. Rather than marking the conclusion of the AIDXL series, it represents a significant step forward, advancing the series to become even more robust and capable.🏷 Model Information 🏷<ul><li>Developed by: <a target="_blank" rel="ugc" href="https://civitai.com/user/Euge_">Euge</a></li><li>Funded by: <a target="_blank" rel="ugc" href="http://Neta.art">Neta.art</a></li><li>Model type: Generative text-to-image model</li><li>Finetuned from model: <a target="_blank" rel="ugc" href="https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0">SDXL 1.0 Base</a></li><li>License: <a target="_blank" rel="ugc" href="https://freedevproject.org/faipl-1.0-sd/">Fair AI Public License 1.0-SD</a></li></ul>🔥<a target="_blank" rel="ugc" href="https://emojipedia.org/ja/%E7%81%AB"> </a>Highlights 🔥<ul><li>Support a lot of <a rel="ugc" href="https://huggingface.co/Eugeoter/artiwaifu-diffusion-1.0/blob/main/references/style.csv">painting styles</a>, <a rel="ugc" href="https://huggingface.co/Eugeoter/artiwaifu-diffusion-1.0/blob/main/references/artist.csv">art styles</a> (9000+) and <a rel="ugc" href="https://huggingface.co/Eugeoter/artiwaifu-diffusion-1.0/blob/main/references/character.csv">characters </a>(6000+)</li><li>Can accurately identify specific quality level, safety level, age of drawing, vintage of drawing and some aesthetic concepts.</li></ul>🚀 Dataset Source 🚀<ul><li>Subset of Danbooru (1.3M). Selected by aesthetic score using <a target="_blank" rel="ugc" href="https://huggingface.co/Eugeoter/waifu-scorer-v3">Waifu Scorer V3</a>.</li><li>Subset of Pixiv (0.1M). Hand-selected.</li><li>Others (0.1M).</li></ul>👀 Future Plan 👀<ul><li>Apply stronger training strategies.</li><li>Continue adding more and more high-quality data.</li></ul>

artiwaifuDiffusion_v10.safetensors

v1.0

v2.0

<ol><li>I'm not the original creator; all glory goes to <a href="https://civitai.com/user/Euge_" rel="ugc noopener noreferrer nofollow" target="_blank">Euge_</a>. <a href="https://civitai.com/user/Euge_" rel="ugc noopener noreferrer nofollow" target="_blank">This </a>module will be returned to the author upon request.</li><li>If you are the original creator and want to claim the module, please leave a comment, and I will delete the module as soon as possible.</li></ol>Due to word limit, please visit <a href="https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768" rel="ugc noopener noreferrer nofollow" target="_blank">https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768</a> <a href="https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768" rel="ugc noopener noreferrer nofollow" target="_blank">for more tutorials.</a><a href="https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768" rel="ugc noopener noreferrer nofollow" target="_blank">ArtiWaifu Diffusion</a><a href="https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768" rel="ugc noopener noreferrer nofollow" target="_blank">We have released the&nbsp;ArtiWaifu </a>Diffusion model, designed to generate aesthetically pleasing and faithfully restored anime-style illustrations.The AWA Diffusion is an iteration of the Stable Diffusion XL model, mastering over&nbsp;6000 artistic styles&nbsp;and more than&nbsp;4000 anime characters, generating images through trigger words.As a specialized image generation model for anime, it excels in producing high-quality anime images, especially in generating images with highly recognizable styles and characters while maintaining a consistently high-quality aesthetic expression.Model DetailsThe AWA Diffusion model is fine-tuned from Stable Diffusion XL, with a selected dataset of&nbsp;1.5M&nbsp;high-quality anime images, covering a wide range of both popular and niche anime concepts up to April 15, 2024. AWA Diffusion employs our most advanced training strategies, enabling users to easily induce the model to generate images of specific characters or styles while maintaining high image quality and aesthetic expression.Model Information<ul><li>Developed by:&nbsp;<a href="https://civitai.com/user/Euge_" rel="ugc noopener noreferrer nofollow" target="_blank">Euge</a></li><li>Funded by:&nbsp;<a href="http://neta.art/" rel="ugc noopener noreferrer nofollow" target="_blank">Neta.art</a></li><li>Model type: Generative text-to-image model</li><li>Finetuned from model:&nbsp;<a href="https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0" rel="ugc noopener noreferrer nofollow" target="_blank">SDXL 1.0 Base</a></li><li>License:&nbsp;<a href="https://freedevproject.org/faipl-1.0-sd/" rel="ugc noopener noreferrer nofollow" target="_blank">Fair AI Public License 1.0-SD</a></li></ul>Usage GuideThis guide will (i) introduce the model's recommended usage methods and prompt writing strategies, aiming to provide suggestions for generation, and (ii) serve as a reference document for model usage, detailing the writing patterns and strategies for trigger words, quality tags, rating tags, style tags, and character tags.Basic Usage<ul><li>CFG scale:&nbsp;5-11</li><li>Resolution: Area (= width x height) around 1024x1024. Not lower than 256x256, and resolutions where both length and width are multiples of 32.</li><li>Sampling method: Euler A (50+ steps) or DPM++ 2M Karras (~35 steps)</li></ul>Due to the special training method, AWA's optimal inference step count are higher than regular values. As the inference steps increase, the quality of the generated images can continue to improve...❓&nbsp;Question:&nbsp;Why not use the standard SDXL resolution?💡&nbsp;Answer:&nbsp;Because the bucketing algorithm used in training does not adhere to a fixed set of buckets. Although this does not conform to positional encoding, we have not observed any adverse effects.Prompting StrategiesAll text-to-image diffusion models have a notoriously high sensitivity to prompt, and AWA Diffusion is no exception. Even a misspelling in the prompt, or even replacing spaces with underscores, can affect the generated results. AWA Diffusion encourages users to write prompt in&nbsp;tags&nbsp;separated by&nbsp;comma + space (&nbsp;,). Although the model also supports natural language descriptions as prompt, or an intermix of both, the tag-by-tag format is more stable and user-friendly.When describing a specific ACG concept, such as a character, style, or scene, we recommend users choose tags from the&nbsp;<a href="https://danbooru.donmai.us/tags" rel="ugc noopener noreferrer nofollow" target="_blank">Danbooru tags</a>&nbsp;and replace underscores in the Danbooru tags with spaces to ensure the model accurately understands your needs. For example,&nbsp;bishop_(chess)&nbsp;should be written as&nbsp;bishop (chess), and in inference tools like AUTOMATIC1111 WebUI that use parentheses to weight prompt, all parentheses within the tags should be escaped, i.e.,&nbsp;bishop \(chess\).Tag OrderingIncluding AWA Diffusion, most diffusion models better understand logically ordered tags. While tag ordering is not mandatory, it can help the model better understand your needs. Generally, the earlier the tag in the order, the greater its impact on generation.Below is an example of tag ordering. The example organizes the order of tags, prepends&nbsp;<a href="https://cayzlh.github.io/tools/online-markdown/#style-tags" rel="ugc noopener noreferrer nofollow" target="_blank">art style tags</a>&nbsp;and&nbsp;<a href="https://cayzlh.github.io/tools/online-markdown/#character-tags" rel="ugc noopener noreferrer nofollow" target="_blank">character tags</a>&nbsp;because style and subject are the most important to the image. Subsequently, other tags are added in order of importance. Lastly,&nbsp;<a href="https://cayzlh.github.io/tools/online-markdown/#aesthetic-tags" rel="ugc noopener noreferrer nofollow" target="_blank">aesthetic tags</a>&nbsp;and&nbsp;<a href="https://cayzlh.github.io/tools/online-markdown/#quality-tags" rel="ugc noopener noreferrer nofollow" target="_blank">quality tags</a>&nbsp;are positioned at the end to further emphasize the aesthetics of the image:art style (by xxx) -&gt; character (1 frieren (sousou no frieren)) -&gt; race (elf) -&gt; composition (cowboy shot) -&gt; painting style (impasto) -&gt; theme (fantasy theme) -&gt; main environment (in the forest, at day) -&gt; background (gradient background) -&gt; action (sitting on ground) -&gt; expression (expressionless) -&gt; main characteristics (white hair) -&gt; other characteristics (twintails, green eyes, parted lip) -&gt; clothing (wearing a white dress) -&gt; clothing accessories (frills) -&gt; other items (holding a magic wand) -&gt; secondary environment (grass, sunshine) -&gt; aesthetics (beautiful color,&nbsp;detailed) -&gt; quality (best&nbsp;quality) -&gt; secondary description (birds, cloud, butterfly)Tag order is not set in stone. Flexibility in writing prompt can yield better results. For example, if the effect of a concept (such as style) is too strong and detracts from the aesthetic appeal of the image, you can move it to a later position to reduce its impact.Negative PromptNegative prompt are not necessary for AWA Diffusion. If you use negative prompt, it is not the case that the more negative prompt, the better. They should be as concise as possible and easily recognizable by the model. Too many negative words may lead to poorer generation results. Here are some recommended scenarios for using negative prompt:<ol><li>Watermark: signature, logo, artist name;</li><li>Quality: worst quality, lowres, ugly, abstract;</li><li>Style: real life, 3d, celluloid, sketch, draft;</li><li>Human anatomy: deformed hand, fused fingers, extra limbs, extra arms, missing arm, extra legs, missing leg, extra digits, fewer digits</li></ol>Trigger WordsAdd trigger words to your prompts to inform the model about the concept you want to generate. Trigger words can include character names, artistic styles, scenes, actions, quality, etc.Tips for Trigger Word<ol><li>Typos: The model is very sensitive to the spelling of trigger words. Even a single letter difference can cause a trigger to fail or lead to unexpected results.</li><li>Bracket Escaping: Pay attention when using inference tools that rely on parentheses for weighting prompt, such as AUTOMATIC1111 WebUI, to escape parentheses in trigger words, e.g.,&nbsp;1lucy(cyberpunk)&nbsp;-&gt;&nbsp;1lucy \(cyberpunk\).</li><li>Triggering Effect Preview：Through searching tags on&nbsp;<a href="https://danbooru.donmai.us/tags" rel="ugc noopener noreferrer nofollow" target="_blank">Danbooru</a>&nbsp;to preview the tag and better understand the tag's meaning and usage.</li></ol>Style TagsStyle tags are divided into two types:&nbsp;Painting Style Tags&nbsp;and&nbsp;Artistic Style Tags.&nbsp;Painting Style Tags&nbsp;describe the painting techniques or media used in the image, such as oil painting, watercolor, flat color, and impasto.&nbsp;Artistic Style Tags&nbsp;represent the artistic style of the artist behind the image.AWA Diffusion supports the following&nbsp;Painting Style Tags:<ul><li>Painting style tags available in the Danbooru tags, such as&nbsp;oil painting,&nbsp;watercolor,&nbsp;flat color, etc.;</li><li>All painting style tags supported by&nbsp;<a href="https://civitai.com/models/124189/anime-illust-diffusion-xl" rel="ugc noopener noreferrer nofollow" target="_blank">AID XL 0.8</a>, such as&nbsp;flat-pasto, etc.;</li><li>All style tags supported by&nbsp;<a href="https://civitai.com/models/410737/neta-art-xl" rel="ugc noopener noreferrer nofollow" target="_blank">Neta Art XL 1.0</a>, such as&nbsp;gufeng, etc.;</li></ul>See the&nbsp;<a href="https://huggingface.co/Eugeoter/artiwaifu-diffusion-1.0/blob/main/references/style.csv" rel="ugc noopener noreferrer nofollow" target="_blank">Painting Style Tags List</a>&nbsp;for full lists of painting style tags.AWA Diffusion supports the following&nbsp;Artistic Style Tags:<ul><li>Artistic style tags available in the Danbooru tags, such as&nbsp;byyoneyama mai,&nbsp;bywlop, etc.;</li><li>All artistic style tags supported by&nbsp;<a href="https://civitai.com/models/124189/anime-illust-diffusion-xl" rel="ugc noopener noreferrer nofollow" target="_blank">AID XL 0.8</a>, such as&nbsp;byantifreeze3,&nbsp;by7thknights, etc.;</li></ul>See the&nbsp;<a href="https://huggingface.co/Eugeoter/artiwaifu-diffusion-1.0/blob/main/references/artist.csv" rel="ugc noopener noreferrer nofollow" target="_blank">Artistic Style Tags List</a>&nbsp;for full lists of artistic style tags.The higher the tag count in the tag repository, the more thoroughly the artistic style has been trained, and the higher the fidelity in generation. Typically, artistic style tags with a count higher than&nbsp;50&nbsp;yield better generation results.Tips for Style Tag<ol><li>Intensity Adjustment: You can adjust the intensity of a style by altering the order or weighting of style tags in your prompt. Frontloading a style tag enhances its effect, while placing it later reduces its effect.</li></ol>❓ Question: Why include the prefix by in artistic style tags?💡 Answer: To clearly inform the model that you want to generate a specific artistic style rather than something else, we recommend including the prefix by in artistic style tags. This differentiates byxxx from xxx, especially when xxx itself carries other meanings, such as dino which could represent either a dinosaur or an artist's identifier. Similarly, when triggering characters, add a 1 as a prefix to the character trigger word.Due to word limit, please visit <a href="https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768" rel="ugc noopener noreferrer nofollow" target="_blank">https://civitai.com/models/435207/artiwaifu-diffusion?modelVersionId=484768</a> for more tutorials.

Files with SHA256: 73ed24bde3bd8146e386c2f9e49d463d8129fc10099559765aac5161dcbff606