Important Notice
The latest version of ComfyUI_frontend contains a critical error related to SubGraph. Please use version 1.39.19. You can either set the ComfyUI launch option to --front-end-version Comfy-Org/[email protected], or downgrade by running pip install comfyui_frontend_package==1.39.19.
Overview
A simple workflow based on the Comfy native workflow for Wan2.2 Animate, with a few minor improvements.
It allows you to load a video, trace its motion, and generate a new video.
Core Features
Motion Trace – Recreates the motion while keeping the prepared character and background.
Swap – Keeps the background of the original video while replacing only the character.
Description
v1.0 : First Release
v1.0.1 : Some bug fix. Ignore BG option added.
FAQ
Comments (16)
Where do you get your example video to put through the workflow?
The image was generated with Z-Image-Turbo, and the video was generated with LTX-2.3.
For LTX-2.3, feel free to try my workflow.
Your examples look nice ! Did you test it with motions with "turning back" ? It's the biggest problem
I tested a spin turn, and it seems to work correctly.
It’s different from what you described as “turning back,” but the body does not appear to twist unnaturally.
Also, the motion quality is simply within the capabilities of Wan2.2 Animate - neither better nor worse.
@javawock7618 I see, gotta test thanks !
Is it okay if the original video is nsfw?
I haven’t tested it myself, but it might work if you add an NSFW LoRA. However, I cannot guarantee it.
A high-quality workflow. Congratulations. The only issue is with the movement of the hands and fingers (unfortunately, this is a common problem). That’s where most of the inconsistencies occur. In any case, congratulations on the effort you’ve put in.
Thank you. The rendering of hands and fingers can be slightly improved by increasing the generation resolution (e.g., 1280×768), although this will reduce generation speed.
помогите решить ошибку
DWPreprocessor
open file failed because of errno 2 on fopen: No such file or directory, file path: E:\иииии\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts\hr16\DWPose-TorchScript-BatchSize5\dw-ll_ucoco_384_bs5.torchscript.pt
этот файл в папке есть
I’m unable to resolve that error myself. It appears to be related to the custom node comfyui_controlnet_aux. Please consider asking for help at the project repository: comfyui_controlnet_aux
https://github.com/Fannovel16/comfyui_controlnet_aux
You may also try reinstalling or updating comfyui_controlnet_aux to the latest version.
There are also reports that this issue can occur if the ComfyUI installation path contains non-English characters, so you may want to check that as well.
Hi, do you know if it's possible to change just the face?
All the errors. Going to mess around with this...was really hoping this would work.
I managed to get it working yesterday on the new comfyUI, it's not stable though, sometimes it works sometimes it doesn't, if I can get it to work consistently, I'll post a comment here on the resolution.
Anyway, great work, it would be nice if there was also a preview of the POSE node, it would be nice to see the final skeleton too.
Thanks for the workflow. How can we set a higher resolution for scail animation and onetoall animation? It gives an error when I change the weight and height values.
Wan is originally designed to support only up to 480p/720p. I haven’t tested it, but 1080p may not be impossible; however, it will likely result in out-of-memory errors or poor output quality.