Originally posted to HuggingFace by Avrik

An experimental Dreambooth model trained on individual frames of looping 3D animations that were then laid out on a 4x4 grid. Generates sprite sheets that can create very interesting abstract animations.

Use the token AbstrAnm spritesheet. Size must be set at 512x512 or your outputs may not work properly.

Example prompt: AbstrAnm spritesheet, animation of a red glowing orb in the sky, highly detailed, fog, atmosphere, glow, sprites, animated, abstract Negative prompt: high contrast, text, overlay Steps: 30, Sampler: DPM++ 2M Karras, CFG scale: 8

Feel free to experiment with other types of prompts and/or model merges.

You can also upscale it 4x to produce 512x512 animations. Used SD Upscale from AUTOMATIC1111's web UI to add more sharpness and detail.

Discovered it's actually quite flexible and could even animate less abstract concepts.

Prompt 1: AbstrAnm spritesheet, animation of magical swirling clouds in the clear blue sky, floating in crystal clear water, circular, sunny, timelapse, lens flare, nature, 35mm lens shot, photorealistic, sprites, animated, art by Greg Rutkowski Negative prompt: text, overlay, abstract, boring, empty, barren, simple background Steps: 25, Sampler: DPM++ 2S a, CFG scale: 10

Prompt 2: AbstrAnm spritesheet, animation of a beautiful flower blowing in the wind, serene, pink, sunny, timelapse, lens flare, nature, 35mm lens shot, photorealistic, sprites, animated, art by Greg Rutkowski Negative prompt: text, overlay, abstract, boring, empty, barren, simple background Steps: 25, Sampler: DPM++ 2S a, CFG scale: 10

Some issues with this model:

• May not loop seamlessly
• Tends to be too noisy
• Sprites aren't usually perfect squares
• Small size and short animation (could experiment with training on larger resolutions in the future)