<h2 id="model-description">Model Description</h2>Mugen is a continuation of our SDXL to Flux 2 VAE conversion, renamed to signify a substantial divergence from the original NoobAI models.It has been trained for 7 additional epochs, totaling under 8000$ for a full latent space conversion, while preserving and improving upon model anime knowledge.In particular, we have paid attention to characters in this iteration, and developed in-house approach for benchmarking their performance, about which you can read below.Overall, model performs particularly well with textures and patterns that were previously simply impossible due to SDXL VAE. We prioritized keeping our training as standard-friendly as possible, so local community can easily train on it like on a new Base Model, which it practically is.We provide 4 models:<ul><li>Mugen: A base model.</li><li>Mugen - Aesthetic: Slightly tuned on a limited dataset model for better quality output.</li><li>Mugen - Aesthetic - Anzhc/Selph: Further tune on opinionated dataset selection.</li></ul><hr /><ul><li>Developed by: Cabal Research (Bluvoll, Anzhc)</li><li>Funded by: Community</li><li>License: <a target="_blank" rel="ugc" href="https://freedevproject.org/faipl-1.0-sd/">fair-ai-public-license-1.0-sd</a></li><li>Resumed from: <a target="_blank" rel="ugc" href="https://huggingface.co/CabalResearch/NoobAI-Flux2VAE-RectifiedFlow">NoobAI Flux2 VAE v0.3</a></li></ul><hr /><h3 id="character-knowledge-benchmark">Character Knowledge Benchmark</h3><a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/trBLD3zcXDsMA1Iwuc4fj.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/trBLD3zcXDsMA1Iwuc4fj.png" alt="series_dashboard" /></a><a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/9RIxkWpmT9j_z2uGOWIXa.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/9RIxkWpmT9j_z2uGOWIXa.png" alt="unified_characters_standalone" /></a>This benchmark measures character similarity across 1815 characters in this iteration of it. For convenience, we've gathered few major categories: gachas and vtubers.We utilize reference(non-generated) set of images, and measure character features against ai-generated data - this is the similarity score. Our custom in-house model for character discrimination trained on ~1.2kk images is used. Results are sorted indiscriminately, by score, treat it as general character knowledge index, not as any specific characters in particular. Same point on graphs might, or might not be corresponding to the same character.Due to compute constraint, we selected only single model to compare against - not yet released latest version of <a target="_blank" rel="ugc" href="https://huggingface.co/ChenkinNoob/ChenkinNoob-XL-V0.3-BETA">Chenkin</a> model, which currently is the most trained SDXL-based anime model.Future benchmark iterations might include different arches, more models and more characters.<h2 id="bias-and-limitations">Bias and Limitations</h2>General data biases from Danbooru might apply.Flux 2 VAE seem to have brown bias overall, which can be alleviated by adding <code>sepia</code> or <code>brown theme</code> to negative.<h2 id="model-output-examples">Model Output Examples</h2><a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/FXQzA7AWIuZnPnOTfBu2V.webp"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/FXQzA7AWIuZnPnOTfBu2V.webp" alt="image-wall-2048x9941.784038936581" /></a>You can download most of those images from <a target="_blank" rel="ugc" href="https://huggingface.co/CabalResearch/Mugen/tree/main/images">Here</a> for reference.<hr /><h1 id="recommendations">Recommendations</h1><h3 id="characters">Characters</h3>While in benchmark we test characters purely with their own trigger with no helper tags, it is advised to utilize series/game for better adherence. Characters that might appear not working initially could start working with appearance tags.<h3 id="inference">Inference</h3> Comfy<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/668lIifTlZ8sYzWlzLVc0.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/668lIifTlZ8sYzWlzLVc0.png" alt="изображение" /></a><a target="_blank" rel="ugc" href="https://huggingface.co/CabalResearch/Mugen/blob/main/Mugen%20Basic.json">BASIC WORKFLOW</a>We will provide a Node, and hope it will be adapted natively in main repo eventually: <a target="_blank" rel="ugc" href="https://github.com/Anzhc/SDXL-Flux2VAE-ComfyUI-Node">https://github.com/Anzhc/SDXL-Flux2VAE-ComfyUI-Node</a>Just install it, and it will patch the model config, no node changes required.<a target="_blank" rel="ugc" href="https://github.com/mcmonkeyprojects/SwarmUI">SwarmUI</a> also requires only the node to be installed.Same as your normal inference, but with addition of SD3 sampling node, as this model is Flow-based.Recommended Parameters: Sampler: Euler A, Euler, DPM++ SDE, etc. Steps: 20-28 CFG: 4-7 Shift: 8-12 Schedule: Normal/Simple/SGM Uniform Positive Quality Tags: <code>masterpiece, best quality</code> Negative Tags: <code>worst quality, normal quality, bad anatomy, sepia</code>Alternative Extended Negative: <code>(worst quality:1.1), normal quality, (bad anatomy:1.1), (blurry:1.1), watermark, sepia, (adversarial noise:1.1), jpeg artifacts</code> (Some of our testers pointed out that they prefer longer negative) A1111 WebUIRecommended WebUI: <a target="_blank" rel="ugc" href="https://github.com/Panchovix/stable-diffusion-webui-reForge">ReForge</a> - has native support for Flow models, and we've PR'd our native support for Flux2vae-based SDXL modification.How to use in ReForge:<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/5H8vNl7ZzUh8F_4japzV9.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/5H8vNl7ZzUh8F_4japzV9.png" alt="изображение" /></a>Support for RF in ReForge is being implemented through a built-in extension:<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/Oo1_7dD2Lv7BRqeV_pUsg.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/Oo1_7dD2Lv7BRqeV_pUsg.png" alt="изображение" /></a>IMPORTANTSet your preview method to this, if you use it.<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/634cf025fe861cc73a2e7dd0/siEBfX41E6D_DUEqaXMgs.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/634cf025fe861cc73a2e7dd0/siEBfX41E6D_DUEqaXMgs.png" alt="imagen" /></a>Flux2VAE does not currently have an appropriate high quality preview method, please use Approx Cheap option, which would allow you to see simple PCA projection(ReForge).Recommended Parameters: Sampler: Euler A Comfy RF, Euler A2, Euler, DPM++ SDE Comfy, etc. ALL VARIANTS MUST BE RF OR COMFY, IF AVAILABLE. In ComfyUI routing is automatic, but not in the case of WebUI. Steps: 20-28 CFG: 4-7(or 7-15, if it appears to be weak/bugged) Shift: 8-12 Schedule: Normal/Simple/SGM Uniform Positive Quality Tags: <code>masterpiece, best quality</code> Negative Tags: <code>worst quality, normal quality, bad anatomy, sepia</code>Alternative Extended Negative: <code>(worst quality:1.1), normal quality, (bad anatomy:1.1), (blurry:1.1), watermark, sepia, (adversarial noise:1.1), jpeg artifacts</code> (Some of our testers pointed out that they prefer longer negative)ADETAILER FIX FOR RF: By default, Adetailer discards Advanced Model Sampling extension, which breaks RF. You need to add AMS to this part of settings:<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/RQMtfm5Xi3V7oNsqXoZJN.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/RQMtfm5Xi3V7oNsqXoZJN.png" alt="изображение" /></a>Add: <code>advanced_model_sampling_script,advanced_model_sampling_script_backported</code> to there.If that does not work, go into adetailer extension, find <a target="_blank" rel="ugc" href="http://args.py">args.py</a>, open it, replace builtinscripts like this:<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/rmnS-i_kciJzTZmeR-mGP.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/rmnS-i_kciJzTZmeR-mGP.png" alt="изображение" /></a>Here is a copypaste for easy copy:<pre><code>_builtin_script = (
 "advanced_model_sampling_script",
 "advanced_model_sampling_script_backported",
 "hypertile_script",
 "soft_inpainting",
)
</code></pre>Or use my fork of Adetailer - <a target="_blank" rel="ugc" href="https://github.com/Anzhc/aadetailer-reforge">https://github.com/Anzhc/aadetailer-reforge</a><hr /><h3 id="lora-training">LoRA Training</h3>You can directly reference config with all parameters: <a target="_blank" rel="ugc" href="https://huggingface.co/CabalResearch/Mugen/blob/main/Training%20Config%20Example.zip">Download</a><a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/_-ysLTJZE4FGNpoTW2b_m.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/_-ysLTJZE4FGNpoTW2b_m.png" alt="изображение" /></a><h3 id="hardware">Hardware</h3>Model was trained on cloud 8xH100 node.<h3 id="software">Software</h3>Custom fork of <a target="_blank" rel="ugc" href="https://github.com/bluvoll/sd-scripts">SD-Scripts</a>(maintained by Bluvoll)<h2 id="acknowledgements">Acknowledgements</h2><h3 id="sponsors">Sponsors</h3>To a special supporter who singlehandidly sponsored whole run and preferred to stay anonymous<h3 id="testers">Testers</h3><ul><li>ComradeAnanas</li><li>Daruda</li><li>Drac</li><li>itterative</li><li>kagame</li><li>Remix</li><li>Ryusho</li><li>edf</li><li>Epic</li><li>Ly</li><li>Panchovix</li><li>Rakosz</li><li>Sab</li><li>Silvelter</li><li>Talan</li><li>Void</li><li>Why ping</li></ul><hr /><h1 id="support">Support</h1>If you wish to support our continuous effort of making waifus 0.2% better, you can do it here:<h3 id="https:ko-fi.combluvoll-(blu-donate-here-to-support-training)"><a target="_blank" rel="ugc" href="https://ko-fi.com/bluvoll">https://ko-fi.com/bluvoll</a> (Blu, donate here to support training)</h3><a target="_blank" rel="ugc" href="https://ko-fi.com/anzhc">https://ko-fi.com/anzhc</a> (Anzhc, non-training, just survival)<a target="_blank" rel="ugc" href="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/qpcOFLCI-B7QBADEYwMhA.png"><img src="https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/qpcOFLCI-B7QBADEYwMhA.png" alt="image" /></a>BTC: <code>37fLcfxX5ewhJXnb3T9Qzu9jiSLjVtoUJX</code> ETH: <code>0xfdF54655796bf2F5bf75192AeB562F8656c1C39E</code>Send DM to Blu if you want to donate on another network.

Files with SHA256: b40460acab7c8dc79eb9ef7c3ea41a3886c92c390e39bb744cf542aa33a9829c