Introduction
The Illustrious Realism Experiment (IRE) is an attempt at a realistic Illustrious model that does not sacrifice its character knowledge, prompt adherence capabilities, and compatibility with Illustrious-based LoRAs. This was mostly accomplished by block merging WAI-illustrious-SDXL v17.0 with CyberRealistic CyberIllustrious v11.0 and a mix of SDXL models (see the credits and version history sections for additional information) using Hako-mikan's SuperMerger; in addition, a custom LoRA trained on a personal dataset of high quality photos has been merged into each version.
The latest version, 6.0, reflects major changes to the block merging process. The result is greatly improved compatibility with DPM samplers. However, IRE remains very experimental (hence the name). Hopefully, future versions will have further improvements to realism and visual fidelity.
Usage Guidelines
Summary:
VAE: already baked in
Prompting: use Booru tags (see below for important tags!)
Sampler: euler a (for v6.0, DPM++ 2M SDE seems to work well)
Scheduler: karras
Steps: ~30
CFG: 2-5
Resolution: 1024x1024, 896x1152, and 832x1216
For the best results, you should use Booru tags and place the following tags at the start of your prompt:
masterpiece, best quality, realistic, photorealisticIncluding the tags below in the negative prompt may also lead to better quality:
bad quality, worst quality, sketch, flat color, lowresThe preview images used the euler a sampler with the karras scheduler at 30 steps, but feel free to experiment with other options (the DPM++ 2M SDE sampler, for example, can produce sharper images). The recommended CFG scale is 2-5, with a lower CFG tending toward more realism, in my opinion. Good resolutions include 1024x1024, 896x1152, and 832x1216.
While the model should be compatible with most Illustrious-based LoRAs, results will vary depending on the LoRA, and you may need to lower the LoRA's strength and/or the CFG scale.
The model has the default SDXL VAE baked into it.
Credits
IRE is based on extensive block merging of various models:
Free free to create new merges using this model, but please do not use them for commercial purposes
Version History
v6.0: Improved visual fidelity and compatibility with DPM samplers by making substantial changes to the block merge process.
v5.0: Incorporated BeautyFoolXL2025 v2.0 and Reality BoundXL Axiom v14 into the merge.
v4.1: Improved LoRA compatibility by making some slight changes to the merge formula.
v4.0: Attempted to improve visual fidelity and realism by making significant changes to the block merging formula.
v3.0: Reduced graininess by integrating CyberRealistic CyberIlustrious v11.0 into the merging process.
v2.0: Made some improvements to visual fidelity by incorporating RealVisXL V5.0 and training on a higher quality dataset for the LoRA merged into the model.
v1.0: Initial version based on a block merge of WAI-illustrious-SDXL v17.0 with UltraEpicAi Realism v2.0.
Description
FAQ
Comments (6)
holy sh*t this is SO good...
For a photo portrait, the best beginning is:
masterpiece, best quality, very aesthetic, incredibly detailed, newest, photo-referenced, (realistic:1.2), photo, (raw photo:1.2) BREAK [..description of the character] BREAK (subsurface scattering:1.1), (ray tracing:1.1), (softbox lighting:1.2), (rim lighting:1.1), 8k, fujifilm, macro lens.
Add to Negative Prompt: ...,(anime:1.3), (cartoon:1.3), (illustration:1.3), (drawing:1.2), digital art, cg, 2d, smooth skin, plastic skin, doll, lowres, wrinkles, blurry, (flat color:1.2), ....,
Sampler: euler_ancestral
Scheduler: Karras
CFG: 5.5
Thank you for the suggestions. For the positive prompt, it's not clear to me whether many of those tags make much a difference, since this is fundamentally an Illustrious model that relies on booru tags, and my personal preference is to keep the CFG below 5. But I'm always happy to see how people experiment with things! ^_^
I may be wrong, analyzing ComfyUI's results, it's impossible to claim an exclusive and unambiguous truth. However, my example - https://civitai.red/posts/29507105 - shows the best result for skin texture. On your checkpoint, illustriousRealism_v40.safetensors, it performs the level of the best SDXL model. On your latest version, illustriousRealism_v50, I haven't achieved this result yet, but I'll try.
@Rahim33 I recommend that you include "photorealistic" in the starting tags! But yeah, I'm not fully satisfied with the visual quality of v5, but it seems to have better LoRA compatibility that the previous versions.
Your model handles the physical interaction between two characters well, and most importantly, it correctly creates male anatomy. Many models do this with just one character, but when there are two in the frame, more than half of the models fail. Your checkpoint, however, makes almost no mistakes and knows almost all the Kama Sutra positions. :)