Foreword
In order to better understand the different types of models, I take the toadstool as the starting point for my investigation. At the moment I can create Embeddings, Hypernetworks as well as LoRAs. The generated results are satisfactory. Later on I will compare this LoRA model with a Hypernetwork and an Embedding. Therefore I will use the same database.
What the Model Does
The LoRA model transforms a mushroom into a realistic toadstool. This is where the characteristics of a mushroom come into play, such as a structured skirt and the scales on the caps. These details make the toadstool looks more natural.
Base Models which Works Well
In principle my LoRA model works with a bunch of base models. Some base models works better than other models.
Test case
One can use one simple test Prompt to check how good or how bad the model works.
Prompt without using the LoRA model:
mushroomPrompt using the LoRA model:
mushroom, <lora:toadstool:1>Trigger Words can be toadstool as well as mushroom or fungus.
Training
I trained the model with 50 photos of a toadstool. The resolution of all square photos are 1024 x 1024 pixel. The background of the used photos varies from sharp to bokeh. The environment in which the mushrooms grow also varies greatly. The stalk of the mushroom has a different length and thickness. The caps of individual toadstools are very different. They range from a flat cap to a spherical cap. Different viewing angles were used. The common feature in the photos is the reddish color of the cap.
Credits
For testing purposes I am using some models more often than others. My thanks go to the following models and their creators for there excellent work.
Lykon → https://civarchive.com/models/81458/absolutereality?modelVersionId=132760
Lykon → https://civarchive.com/models/4384?modelVersionId=128713
sinatra → https://civarchive.com/models/153568/real-dream?modelVersionId=433727
KandooAI → https://civarchive.com/models/46422/juggernaut?modelVersionId=274039
I am successively expanding the above list.
Finally
Have a nice day! Have fun! Be inspired!