<p>Made this on complete accident. I think this serves as a practical exercise in what applying a huge amount of lineart style LoRAs to a model until it's almost ruined and then replacing unet blocks IN06, IN07, IN08, OUT05, OUT4, and OUT3 with that of realistic model does.</p><p>This model creates a sort of sketchbook like effect to the model. You've got the bones of a semi-realistic model as far as anatomy goes but it looks like someone drew it in with pencil. I call it Perfect Sketch, because basically you can throw any prompt you'd use on Perfect World in here and it'll work.</p><p>I can do a more detailed explanation of why this works if anyone's interested but if you're only interested in prompting here are the usage recommendations.</p><h3>Usage</h3><p>Ideally you should prompt for realism for best effects. With SketchyAnimeStyle it doesn't really matter, but with SketchStyle it will help a lot. If you don't want to come up with your own prompt, just insert this before your prompt.</p><pre><code>(ultra high detail, realistic, best quality, 8k raw, masterpiece)

BREAK</code></pre><p>As far as negatives go, keep it simple. Once again, if you don't want to come up with your own prompt, I generally like to use this.</p><pre><code>easynegative, (worst quality, low quality:1.4), (monochrome:1.1), watermark</code></pre><p>Don't use latent upscaler and if you upscale at 2 or below keep the denoise at 0.4 or below.</p><p>With SketchyStyle you should use a upscaler otherwise the facial details will not resolve. With SketchyAnimeStyle it doesn't really matter that much though obviously upscaling is better.</p><h3>Process</h3><p><a target="_blank" rel="ugc" href="https://huggingface.co/Jemnite/SketchbookStyle">Huggingface</a></p><p>Generally speaking, anything between OU03toOUT5/IN8toIN6 is responsible for segmenting the face and body. I was trying to correct anatomy breakdown after fucking up the weights with loras so I replaced the parts of the unet responsible for compressing and uncompressing the body features with those of the functioning model I started with. This enforces the anatomy of that model into this one to some degree while leaving the fine details intact. I think this could be used as a generalized approach, where you can apply loras to change style and then revert certain blocks to restore anatomy or aesthetic composition. However, this technique is largely experimental and needs more research.</p>

Files with SHA256: d925974d9d1a1c491f905c1237f4c88418047a287885a1c37d0ed921091bc333