Coloring Book HiDream
This HiDream LoRA is Lycoris based and produces great line art styles and coloring book images. I found the results to be much stronger than my Coloring Book Flux LoRA. Hope this clearly demonstrates the quality that can be achieved with this awesome model.
I recommend using LCM sampler with the simple scheduler, for some reason using other samplers resulted in hallucinations that affected quality when LoRAs are utilized. Some of the images in the gallery will have prompt examples.
Trigger words: c0l0ringb00k, coloring book
Recommended Sampler: LCM
Recommended Scheduler: SIMPLE
Recommended Strength: 0.3-0.6
This model was trained to 2000 steps, 2 repeats with a learning rate of 4e-4 trained with Simple Tuner using the main branch. The dataset was around 90 synthetic images in total. All of the images used were 1:1 aspect ratio at 1024x1024 to fit into VRAM.
Training took around 3 hours using an RTX 4090 with 24GB VRAM, training times are on par with Flux LoRA training. Captioning was done using Joy Caption Batch with modified instructions and a token limit of 128 tokens (more than that gets truncated during training).
The resulting LoRA can produce some really great coloring book images with either simple designs or more intricate designs based on prompts. I'm not here to troubleshoot installation issues or field endless questions, each environment is completely different.
I trained the model with Full and ran inference in ComfyUI using the Dev model, it is said that this is the best strategy to get high quality outputs. Workflows are attached to every image in the gallery, just drag and drop into ComfyUI.