[WIP] 4Koma Animation - Achieving Temporal Stability with Grids
4Koma (四コマ) is a Japanese term that refers to the classic four-panel comic style. It's a concise way of telling a story in just four panels, with each panel serving a specific purpose: introduction, development, climax, and resolution. I've been inspired by this format and have been experimenting with a project that aims to achieve temporal stability in animation using grids.
Temporal stability is crucial for creating smooth and consistent motion. A method I've been exploring to achieve this stability is the use of grids. It's worth noting that several LoRAs use this grid-based approach, but most of them are NSFW . My goal is to create a set of LoRAs that enable the formation of 2x2, 3x3, and 4x4 grids for a wider audience.
As of now, I've had some success using this LoRa in conjunction with Gif panels in controlnet. I've also tried using it alongside other NSFW grid-based LoRAs, but only on very low strength settings. The training was done with a dataset of 25 split anime Gifs, using the base settings provided in the LoRa Colab notebook.
This project is very much a work in progress, and I'm excited to share it with all of you. I encourage you to experiment with my concept, merge it with other ideas, and improve upon it. Let's collaborate and see where our creativity takes us!
Here's the link to my Automatic 1111 script for converting between Gifs and Grids: (please note that it's still a work in progress as well): [GitHub link]
I'm looking forward to hearing your thoughts and suggestions.
Description
Trained on 25 anime Gifs split into 2x2 grids using vanilla setting to prove concept. Concept is proven will train better version soon.