I am sharing how I trained this model with full details and even the dataset: please read entire post very carefully.This model is purely trained for educational and research purposes only for SFW and ethical image generation.The workflow and the config used in this tutorial can be used to train clothing, items, animals, pets, objects, styles, simply anything.The uploaded images have SwarmUI metadata and can be re-generated exactly. For generations FP16 model used but FP8 should yield almost same quality. Don't forget to have used yolo face masking model in prompts.<h2 id="how-to-use-rl3stuikr">How To Use</h2>Download model into LoRA folder of the SwarmUI. Then you need to use Clip-L and T5-XXL models as well. I recommend T5-XXL FP16 or Scaled FP8 version.A newest fully public tutorial here for how to use :<div data-youtube-video><iframe width="640" height="480" allowfullscreen="true" autoplay="false" disablekbcontrols="false" enableiframeapi="false" endtime="0" ivloadpolicy="0" loop="false" modestbranding="false" origin playlist src="https://www.youtube.com/embed/-zOKhoO9a5s" start="0"></iframe></div>I have trained both FLUX LoRA and Fine-Tuning / DreamBooth model.Activation token / trigger word : ohwx manEach training was up to 200 epochs and once every 10 epoch checkpoints saved and shared on below Hugging Face Repo : <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline">https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline</a>This model contains experimental results comparing Fine-Tuning / DreamBooth and LoRA training approaches.<h2 id="additional-resources-rv1kjhns3">Additional Resources</h2><ul><li>Installers and Config Files : <a target="_blank" rel="ugc" href="https://www.patreon.com/posts/112099700">https://www.patreon.com/posts/112099700</a></li><li>FLUX Fine-Tuning / DreamBooth Zero-to-Hero Tutorial : <a target="_blank" rel="ugc" href="https://youtu.be/FvpWy1x5etM">https://youtu.be/FvpWy1x5etM</a></li><li><div data-youtube-video><iframe width="640" height="480" allowfullscreen="true" autoplay="false" disablekbcontrols="false" enableiframeapi="false" endtime="0" ivloadpolicy="0" loop="false" modestbranding="false" origin playlist src="https://www.youtube.com/embed/FvpWy1x5etM" start="0"></iframe></div></li><li></li><li>FLUX LoRA Training Zero-to-Hero Tutorial : <a target="_blank" rel="ugc" href="https://youtu.be/nySGu12Y05k">https://youtu.be/nySGu12Y05k</a></li><li><div data-youtube-video><iframe width="640" height="480" allowfullscreen="true" autoplay="false" disablekbcontrols="false" enableiframeapi="false" endtime="0" ivloadpolicy="0" loop="false" modestbranding="false" origin playlist src="https://www.youtube.com/embed/nySGu12Y05k" start="0"></iframe></div></li><li>Complete Dataset, Training Config Json Files and Testing Prompts : <a target="_blank" rel="ugc" href="https://www.patreon.com/posts/114972274">https://www.patreon.com/posts/114972274</a></li><li>Click below link to download all trained LoRA and Fine-Tuning / DreamBooth checkpoints for free</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/tree/main">https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/tree/main</a></li></ul><h2 id="environment-setup-fb9uar070">Environment Setup</h2><ul><li>Kohya GUI Version: <code>021c6f5ae3055320a56967284e759620c349aa56</code></li><li>Torch: 2.5.1</li><li>xFormers: 0.0.28.post3</li></ul><h2 id="dataset-information-qye0nukft">Dataset Information</h2><ul><li>Resolution: 1024x1024</li><li>Dataset Size: 28 images</li><li>Captions: "ohwx man" (nothing else)</li><li>Activation Token/Trigger Word: "ohwx man"</li></ul><h2 id="fine-tuning-dreambooth-experiment-vn91pr00r">Fine-Tuning / DreamBooth Experiment</h2><h3 id="configuration-4l9xvxx31">Configuration</h3><ul><li>Config File: <code>48GB_GPU_28200MB_6.4_second_it_Tier_1.json</code></li><li>Training: Up to 200 epochs with consistent config</li><li>Optimal Result: Epoch 170 (subjective assessment)</li></ul><h3 id="results-zhcg6iojt">Results</h3><ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/Dwayne_Fine_Tune_Realism_Test_Part1.jpg">Realism Test Part 1</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/Dwayne_Fine_Tune_Realism_Test_Part2.jpg">Realism Test Part 2</a></li></ul><h2 id="lora-experiment-4ub36u3fu">LoRA Experiment</h2><h3 id="configuration-19kkzc8zp">Configuration</h3><ul><li>Config File: <code>Rank_1_29500MB_8_85_Second_IT.json</code></li><li>Training: Up to 200 epochs</li><li>Optimal Result: Epoch 160 (subjective assessment)</li></ul><h3 id="results-e1x0kirzl">Results</h3><ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/Dwayne_LoRA_Realism_Test_Part1.jpg">LoRA Realism Test Part 1</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/Dwayne_LoRA_Realism_Test_Part2.jpg">LoRA Realism Test Part 2</a></li></ul><h2 id="comparison-results-sdx7p8896">Comparison Results</h2><ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/LoRA_90_Epoch_vs_LoRA_160_Epoch_vs_Fine_Tuning_170_Epoch.jpg">LoRA 90 vs 160 vs Fine-Tuning 170 Comparison</a></li><li>I have tested FP8 vs FP16 vs FP32 LoRA Difference As a Grid</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/LoRA_Precision_FP8_vs_FP16_vs_FP32_Grid.jpg">LoRA_Precision_FP8_vs_FP16_vs_FP32_Grid.jpg</a></li><li>Model Variants Are Also Tested With The LoRA - FP32 Version</li><li>FP8 FLUX DEV Base vs FP8 Scaled vs GGUF 8 vs FLUX DEV :<ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline/blob/main/Model_Variants_Tests_Grid.jpg">Model_Variants_Tests_Grid.jpg</a></li></ul></li><li>Works best with FP16 DEV base model, then GGUF 8 base model and then FP8 raw base model and FP8 scaled model sometimes works better sometimes worse </li></ul><h3 id="key-observations-rcz893sc2">Key Observations</h3><ul><li>LoRA demonstrates excellent realism but shows more obvious overfitting when generating stylized images.</li><li>Fine-Tuning / DreamBooth is better than LoRA as expected.</li><li>FP8 almost yields perfect quality as FP32 with LoRA</li><li>I have used Kohya GUI to convert FP32 saved LoRAs into FP16 and FP8<ul><li>Here full public article : <a target="_blank" rel="ugc" href="https://www.patreon.com/posts/115376830">https://www.patreon.com/posts/115376830</a></li></ul></li></ul><h2 id="model-naming-convention-eqzimwcih">Model Naming Convention</h2><h3 id="fine-tuning-models-vvye97lpc">Fine-Tuning Models</h3><ul><li><code>Dwayne_Johnson_FLUX_Fine_Tuning-000010.safetensors</code><ul><li>10 epochs</li><li>280 steps (28 images × 10 epochs)</li><li>Batch size: 1</li><li>Resolution: 1024x1024</li></ul></li><li><code>Dwayne_Johnson_FLUX_Fine_Tuning-000020.safetensors</code><ul><li>20 epochs</li><li>560 steps (28 images × 20 epochs)</li><li>Batch size: 1</li><li>Resolution: 1024x1024</li></ul></li></ul><h3 id="lora-models-ay1j50nv8">LoRA Models</h3><ul><li><code>Dwayne_Johnson_FLUX_LoRA-000010.safetensors</code><ul><li>10 epochs</li><li>280 steps (28 images × 10 epochs)</li><li>Batch size: 1</li><li>Resolution: 1024x1024</li></ul></li><li><code>Dwayne_Johnson_FLUX_LoRA-000020.safetensors</code><ul><li>20 epochs</li><li>560 steps (28 images × 20 epochs)</li><li>Batch size: 1</li><li>Resolution: 1024x1024</li></ul></li></ul>

Dwayne Johnson aka The Rock FLUX Dev LoRA Model for Educational and Research Purposes - Full Tutorial

For Full Details, Training Dataset, Tutorial, Guide, Configs, Training Json Files, Workflows, Installers, Resources and All Checkpoints &gt; <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline">https://huggingface.co/MonsterMMORPG/Model_Training_Experiments_As_A_Baseline</a>This is FP16 converted version of original FP32 training

Files with SHA256: a76d9047fc838f90a1cbf6c8ff1b5647e61f40c2157a6bdc4bd9aa767681872f