So, you're wondering about how to create pseudo-3D parallax gifs. Luckily, it's very easy!I'll be specifically going about using this on existing images, as you're probably not trying to animate every single thing your SD generates, although it would be possible with Option 2.Although I'll be mainly talking about generated images, this exact process works with just about any picture.Attached are the two images I've showcased for you to play around with, I'd just ask for you not to re-upload them. Otherwise, generation data is available in the still (non-animated) images posted.<h3>Option 1: LeiaPix</h3>Great results in seconds, external toolOption number 1 is using an external tool, the <code>LeiaPix Converter</code>. It can be found <a target="_blank" rel="ugc" href="https://convert.leiapix.com/">here</a>.You have to create an account on the site, but the tool is (currently) completely free to use. All you have to do is drop your image into the site after making an account and wait for the processing to complete. You can then play around with the options to the left, which are all completely self-explanatory. Under the "Depth Map" tab to the far left you can override the automatically generated depth map, which is quite finicky.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b85fba5d-91b1-4fb5-b44c-574a3fb8ab00/width=525/b85fba5d-91b1-4fb5-b44c-574a3fb8ab00.jpeg" /><h3>Option 2: WebUI-Extension</h3>Takes a few minutes to run and results are slightly less good, but runs locallyNote: this should work with Collab, but I have absolutely no experience with that so this guide focuses on local installations of SD using AUTOMATIC1111s WebUI.If you're like me and don't want to rely on external tools which may or not stay free to use, you can use an extension for the WebUI called <code>Depthmap Script</code>.In your WebUI, open the the extensions tab, head to <code>Install from URL</code> and paste the following into the first input field: <code>https://github.com/thygate/stable-diffusion-webui-depthmap-script.git</code> Then just hit <code>Install</code>, wait for the process to complete (have an eye on the output of your Terminal window running the <code>.bat</code>-Script - if you're on Windows), then just head back to the <code>Installed</code> tab and hit <code>Apply and restart UI</code>.After reloading, there is a new Tab in your WebUI, labeled <code>Depth</code>.<ul><li>On the left side, select the Single Image tab and drop your picture into the box.</li><li>Choose a model to generate your depth map, I prefer <code>zoedepth</code> in the indoor and outdoor variety.</li><li>Uncheck <code>BOOST</code> if you don't have a lot of VRAM. <code>BOOST</code> gives better results, but is very VRAM intensive and couldn't handle 512px² on my 8GB VRAM card. You can try; watch your terminal output for VRAM errors.<ul><li>If you you've unchecked <code>BOOST</code>, set the resolution. If you're working with smaller pictures (eg. 512px²), select <code>Match input size</code>. If you're getting VRAM issues, uncheck <code>Match input size</code> and set the resolution manually. Match the aspect ratio of your input.</li></ul></li><li>Uncheck <code>Save DepthMap</code>, check <code>Generate 3D inpainted mesh</code> (and optionally <code>Generate 4 demo videos</code>, although I found those not to be very helpful).</li><li>Hit the <code>Generate</code>-Button under the input image, not to the right.</li><li>Monitor your terminal output. The script will download your chosen model, than do the depth-analysis. On my somewhat okay graphics card, this takes around 3-5 minutes for 512px² images.</li><li>After the process is complete, head to the <code>Generate video</code> tab on the right. The input mesh should automatically fill, otherwise you'll have to point it to the path of the generated mesh. In my case (Windows, custom saving folders), this would for example be <code>outputs/extras-images\depthmap-0004.obj</code>.</li><li>Now you can start playing around with the settings! For noticeable-but-subtle effects, I use <code>300 frames, 24fps, circle trajectory, -0.004, 0.0, -0.005 translation, 0.03, 0.03, 0.05, 0.03 cropping, no dolly</code>. For faster animations, you could lower the number of frames or raise the framerate; for more noticeable movements increase the translation amounts. I'd advise against large translation motions however, because the inpainted corner will become extremely obvious.</li><li>Hit <code>Generate Video</code>. It takes just a few seconds (depending on frame count), so trial-and-error parameters are feasible. The output is in your <code>extras</code> folder.</li></ul>Note:<ul><li>After you've got a video you're happy with, you can safely clean up the depth map and mesh from your <code>extras</code> folder.</li><li>You can automatically create those meshes during render in txt2img and img2img using the <code>scripts</code> dropdown. However, this will create a depth map every time you render something, which really is just wasted time and electricity in my opinion as opposed to doing it once with the one image you actually want to animate. </li></ul>Have fun bringing your GPUs creations to life!

Files with SHA256: 684fa90ea4990379ce71ccc50ab452022b88e9c35b435b3491cda460f3726e7a