This is a merged Illustrious checkpoint made with intention of creating realistic character generations without losing most of the innate Illustrious knowledge.
V2 should be a decent improvement overall, with much better faces, lighting and knowledge, but colder colors. This is probably the last version I release for a while. Any merge I try causes a quality degradation in some aspects. Credit in merges would be appreciated.
All of the example images are made with the usage of Hiresfix and ADetailer using only this checkpoint. Feel free to ask any questions about the exact usage.
Short usage guide
DPM++ 2M SDE, Karras, 30-50 steps, CFG 3-5.
General usage prompt:
beautiful,cute,photorealistic,photo,ultra realistic,extremely detailed,volumetric lighting,Negative:
big anime eyes,anime face,big eyes,uglyThese prompts should yield pretty good results overall, but skin detail might be lacking, so if you need more details add these prompts and specify clothing:
natural skin,realistic skin,skin imperfectionsModel pros:
Good character and concept knowledge, you can generate almost any character that base illustrious can if you specify a couple of design details.
Faces and skin look reasonably realistic for said character knowledge degree.
Really good lighting, you can generate actual night scenes or harsh shadows, without it looking like the whole image is lit by a spotlight.
Cons:
Same-ish faces, they will still change with the usage of quality tags, specifying a different ethnicity or with different characters.
Some character will have very 2.5D faces, so you would probably need to lower character prompt strength with a combination of suggested tags to get decent realistic results.
Some expressions are a bit cartoonish. Using 50+ steps for them is a good idea. Looks a bit more natural.
Detailed usage guide
DPM++ 2M SDE or DPM++ SDE, Karras, 30-50 steps, CFG 3-5.
I don't recommend using Euler A, skin details will be lost compared to any DPM SDE.
Most of my images are 1040x1560 upscaled to 1456x2184 with HiresFix, only because it’s the max resolution my VRAM allows without OOM messages and weird anatomy, lower ones should be more stable.
I’m almost always using ADetailer with 0.2-0.4 denoise and HiresFix with 0.3-0.4 denoise and 1.4-2 upscale with Lanczos or without specified upscaler.
Prompts
Don't spam quality tags without thought, it won’t necessarily improve the image.
I generally use 3 different sets of tags, mostly the second one:
Prompt 1:
realistic,detailed,detailed face,volumetric lighting, cute,beautiful |NEGATIVE| (anime,big eyes,anime eyes:1.2)Prompt 2:
beautiful,cute,photorealistic,photo,ultra realistic,extremely detailed,dynamic pose,volumetric lighting, |NEGATIVE| big anime eyes,anime face,big eyes,uglyPrompt 3:
masterpiece,best quality,newest,absurdres,highres,realistic,detailed,detailed face,volumetric lighting,beautiful |NEGATIVE| (big anime eyes,anime face:1.5),(ugly)
I highly recommend using Forge webui if you have any VRAM problems with higher resolutions because it has built-in Tiled VAE, which can allow you to generate up to 8k resolution pictures with the sacrifice of generation time even with 6gb-8gb VRAM. Use Never OOM in txt2img.
https://github.com/lllyasviel/stable-diffusion-webui-forge/releases/tag/latest
For prompts I recommend using this spreadsheet, this model is mostly Illustrious, but has basic knowledge of NoobAI tags, so use whatever. You can sort it by characters by typing ”,4,” in the search bar.
https://github.com/BetaDoggo/danbooru-tag-list/releases/tag/Model-Tags
For multiple people I recommend Forge Couple extension, it allows character features to not be mixed up, similar to regional prompter. Maintaining a good lighting can get a little bit trickier the smaller the image segment per character becomes.
https://github.com/Haoming02/sd-forge-couple
Models used in merge:
Quintillus - "Reality https://civarchive.com/models/1131256
Uncanny valley https://civarchive.com/models/507472
LeafVice [ illustrious ] by Leaf https://civarchive.com/models/1177564
RealVisXL V5.0 https://civarchive.com/models/139562/realvisxl-v50
Description
Prettier faces, better lighting and knowledge, colder colors.
FAQ
Comments (10)
looks pretty okay, generations tend to be slightly more dark than other checkpoints
Yeah, seems about right. It was created because I didn't like how washed out a lot of other Illustrious checkpoints looked, especially in night and rain condition in addition to the lack of knowledge of most realistic models. You can add "day" or "daylight" to get pretty clear bright pictures.
the lighting in the v2 is a vast improvement from the v1, still going to play more with it. most Illustrious models claim to 2.5d/3d semi- or near realistic anime have terrible lighting, and gens often look to bright despite fighting with prompts like dark sky, darkness, night,.
if you make a another version, try focusing or baking in more darkness like this lora https://civitai.com/models/902671/sdxl-darkness
in this current v2.0 model of yours, character loras tend to break the dark or volumetric or realistic lighting. it like they become a celebrity in a sense that lights is directed in front of them despite the moon or sun is behind them. it has poor sense of light direction.
I don't want to overdo it with lighting loras, otherwise every picture will look too dark. I also don't use character loras at all, but I encountered some characters which just refused to have good lighting without increasing weights of lighting prompts. For your case try "backlight" if you specify moon or sun in picture, at least this works with the base model.
Great work.
Please Pony
Sadly, I won't able to work on new models for a couple of months, hardware issues. Maybe I'll try when I will be able to. But I'm actually curious what are the benefits of using Pony for realistic models? I thought Pony is kinda outdated and the only benefit is the drawing style which some people prefer?
@diffusor1650 I’m always waiting for your new models.
A fantastic checkpoint. After I discovered it, ended up deleting a whole collection of checkpoints from my hard drive. I use nothing but this guy.