CivArchive
    AnimateDiff Motion Modules - v1.5 v2

    Originally shared on GitHub by guoyww

    Learn about how to run this model to create animated images on GitHub.

    Choose the version that aligns with the version your desired model was based on.

    Description

    FAQ

    Comments (45)

    shatteredSep 27, 2023· 1 reaction
    CivitAI

    Is there any way to force it to use your initial image as the first frame in img2img mode? I'm trying to animate existing images, and the only option is to let it redraw the first frame.

    TtonkaOct 5, 2023· 1 reaction

    use control net in txt-to-image

    YukiLaneigeOct 8, 2023
    CivitAI

    If I use more than 75 tokens in a positive prompt, it will generate a different composition for every 16 frame.
    How to fix it?

    lavasplit753Oct 8, 2023

    I'm running into this problem even with less than 75 tokens

    YukiLaneigeOct 8, 2023

    @lavasplit753 You may be using styles whose tokens do not shown in the token total.

    lavasplit753Oct 8, 2023

    @YukiLaneige like LORAs?

    YukiLaneigeOct 9, 2023

    @lavasplit753 I'm not sure about this, I haven't tested LORAs.

    lavasplit753Oct 9, 2023

    @YukiLaneige Yeah, for me it seems to be LORAs and Textual Inversions that bloat out the token count.

    unstableconfusionOct 23, 2023· 1 reaction

    @lavasplit753 on the github page, it tells a1111 users to go to settings > optimizations > and check the box that says "pad prompt & Neg to be the same length". this helped me get it working..

    PromptAddictOct 24, 2023

    stop using so many words lol

    YukiLaneigeOct 25, 2023

    @PromptAddict "realistic ass, small ass, rounded shape ass, beautiful ass, detailed ass, masterpiece ass, closeup ass, focus ass, vivid ass, funny ass, aggressive ass, etc" Is that so much to ask?)

    Okay, I just learned to use "negative prompt" adequately, so I always have exactly 75 tokens here and in "positive prompt".

    Ponze_3D_Artist_NSFWOct 18, 2023
    CivitAI

    RuntimeError: CUDA error: invalid configuration argument CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

    how can i fix this error? sometimes work sometime i have this error and SOMEFKK time the render is a rainbow pixelated noise -_-

    gtx1080 8giga all extension, ui etc work perfectly... only this one dosnt work ( allready tried to download directly from github)

    RoscosmosOct 18, 2023

    using hi-res fix?, that will trigger it.

    UnknownUsersOct 19, 2023

    You're hitting a VRAM limit from the upscale ratio + # frames to generate.

    enochianborgOct 19, 2023

    @UnknownUsers This happens even if use --lowvram and push to cpu etc. There is something preventing it from working. I'm able to run the same concept with mov2mov and img2img with controlnet batch.... no problem... no matter what I do with this extension it either locks or runtime error.

    JazzButcherOct 19, 2023

    if you use AnimateDiff as an extension of A1111. change the settings to "Optimize attention layers with sdp" instead of "Optimize attention layers with xformers" in the settings tab of A1111

    hslawOct 24, 2023

    I am having this same issue. Anyone figure out how to fix it?

    IlluseOct 19, 2023· 4 reactions
    CivitAI

    Can anyone share the comfy ui workflow with QR monster and control net

    Meaca_GOct 20, 2023
    CivitAI

    I am getting the animation running forwards, and then in reverse - how do I stop it paying in reverse?

    wooblyOct 20, 2023

    If you're using comfy, the node that assembles frames into animation should have and option called 'ping pong' which can be turned off.

    Meaca_GOct 20, 2023

    @woobly thanks for this, will look in to it

    efastcurexOct 23, 2023· 3 reactions
    CivitAI

    everytime when I need generate animation, have to restart webui again. It only can generate 1 animation once restart. otherwise It will report error, did someone know how to fix it

    terboOct 24, 2023

    update automatic 1111 including pip modules and extensions, and disable any unneeded extensions, run at 256x256, etc

    efastcurexOct 24, 2023

    @terbo yes, I've noticed that there's no RAM left after generating a larger size, so it can not generate again, close the webui-user.bat to release memory, seems Animatediff can not release memory completly

    PromptAddictOct 24, 2023

    @terbo that doesn't solve a memory leak

    efastcurexOct 25, 2023

    @PromptAddict I have a 12gb card, when I need to generate 512 x 768 animation, the method works for me. close then reopen, but I still hope animatediff can free memory itself

    jasonrat504529Nov 1, 2023

    How are you guys getting these errors? Im in auto1111 and never encountered them. Never had to restart the UI. And in on 3060 12gb vram

    efastcurexNov 1, 2023

    @jasonrat504529 what resolution of animation do you generate

    jasonrat504529Nov 1, 2023

    @efastcurex the standard 512x768. If I go over that, it just gives me static noise. You should try Comfyui if auto1111 is giving u errors as it can generate larger than 512x768. I even did 1024 x 1024 in Comfyui.

    I think it might be extensions that conflict with animatediff in auto1111 because I uninstalled a lot of them before I installed animatediff.

    216375Nov 1, 2023· 1 reaction

    I found that if you can only use ADetailer for one run then you have to restart, so make sure you don't have it enabled and use it when you upscale after

    efastcurexNov 1, 2023

    @nexus5teo273 Yes, it's the reason. but the problem is regenerate time is much longer than restart time

    efastcurexNov 2, 2023

    @jasonrat504529 Does Comfyui hard to learn

    50826Nov 6, 2023· 1 reaction

    Wow, I can't even get a single animation to work. Freshly updated. It's just a grid of different images and nothing else.

    saucheibNov 10, 2023

    @easyfruit5000 same

    @easyfruit5000 probably you use a sdxl checkpoint... thets the results

    efastcurexNov 10, 2023

    @easyfruit5000 Try setting context batch size to default value 16 or higher, or use more stable motion module : https://huggingface.co/manshoety/AD_Stabilized_Motion/tree/main

    Legend_of_RayNov 11, 2023· 1 reaction

    This works with Auto1111 using the --disable-safe-unpickle in command line. Continue-Revolution mentioned this in the extension update. Make sure your batch size matches the fps, and the fps divides evenly into the amount of frames your rendering. If you use prompt traveling, your final prompt frame should be a value less then the amount frames your rendering. Use the new feature Nvidia provided in the the drivers update: Cuda prefer system fallback in control panel. Lastly make sure Cuda and CudNN are installed correctly. This will also use a lot of system ram so keep that in mind...Hope this helps!

    Sp1caeNov 3, 2023
    CivitAI

    你好这个模型可以搭配sdxl使用吗

    efastcurexNov 3, 2023· 4 reactions
    CivitAI

    I just write a tutorial on animatediff, record my experience

    subhajit28101999224Nov 4, 2023
    CivitAI

    Can anyone guide me how to install this. I mean this file. Everything that's written on Github went over my head

    yakadayaNov 5, 2023· 1 reaction

    Inside stable-diffusion-webui you should have animatediff installed, inside this folder there is a "model" folder. copy this model into that folder

    @yakadaya Isn't there a way to install this via Safetensor like copy paste link? I use Sage Maker Studio Lab for AUTOMATIC1111

    ZUSIMONov 6, 2023

    Copy paste model into your Model Folder inside of Comfyui/StableDiffusion

    PookieNumnumsNov 18, 2023

    you should install comfy ui then you can simply drag and drop an image that contains the workflow into comfy directly, then go to the node manager and install missing nodes. as someone who recently swapped to comfyui after using automatic for the last 18 months, i say dont bother with automatic anymore.