Odinson-SDXL
+ vid2vid
+ OpenPoseXL2
+ animateDiff XL
+ Lora loader
(default strength 1.0 <- change this)
Versions:
V9 - initial release (used OpenposeXL by default, slow)
V10 - desaturated input (used with Lora Sketch XL, fast)
V11 - same as V10, (Interpolation now after ksampler, fast)
use comfyui manage to install missing nodes & models
you will need:
Any SDXL Checkpoint
Any SDXL Lora
Any SDXL ControlNets
Rife49.pth (comfyui frame interpolation)
ip-adapter_sdxl_vit-h.safetensors (comfyui ipadapter plus)
CLIP-VIT-H-14-laion2B-s32B-b79k.safetensors (CLIP Vision)
mm_sdxl_v10_beta.ckpt (animateDiff evolved)
check the screenshots below!
at 1024 expect ~22GB VRAM
at 768 expect ~12GB
reduce the dimension to reduce the load.
Be careful with your video size ! this is 1024x1024 (large)
Pick video input and set the frame range:
Check the maximum size for the longest side (clamp)
Check Frame interpolation (2 = double input frames)
select the ControlNet (OpenposeXL2 shown)
Check IP Adapter settings and load style image
Set final resolution here (use 1024 for no upscale)
Set Final Framerate
Load Lora & check Animatediff settings (should be the same)
Finally set your Prompt and you can start the generation
Description
moved interpolation to after the Ksampler stage
FAQ
Comments (8)
Sorry if this is a bad question but I am new to ComfyUI (from A111). I get this error when I try to queue: SyntaxError: Unexpected non-whitespace character after JSON at position 4 (line 1 column 5)
Any idea what I have wrong? I think I downloaded all the missing models and nodes.
i have not seen this error before, try to download the workflow again, it was reuploaded. also V10 is much faster and you can modify that just as easy if you need to.
@driftjohnson It was my error. Some of the missing models required a full restart. I think I have it working now. Thank you so much for replying.
oh this looks cool. very nice
Somehow gets stuck around the Load Image node in the IPAdapter group. Also, Needed to replace IPAdapter Apply with Advanced. I'll try and see whats up.
yes, the older the workflow the more updates from the authors of the nodes used, often you can rebuild the node by right clicking on it, this will solve most problems.
@driftjohnson Thanks drift. Looks like things got stuck for me at the Load Image node #116 after replacing the missing nodes.
@Domchimpo i guess if it's still stuck there, try a different load image node, there are a bunch, maybe a different one can work :)