Support me for update
2025/2/8
update v1.5, add word cloud transfer
2024/9/22
Rewrote the edge detection function
and removed the #include "lygia/space/ratio.glsl" line
2024/9/4
update v1.4, automatic edge detection and replacement
2024/8/11
update v1.3. add SDXL upscale and more stable replace bg
2024/7/29
Simple Auto Mask For Videos @SouthbayJa
2024/7/14
update v1.2. Dance References
2024/7/12
For new comfyUI users, check your input model, like Lora. checkpoint, controlnet, aniamtediff, and upscale model, and don't forget to update your comfyUI all. There is a screenshot of the node in the download file for reference.
2024/7/9
Don’t let my reference examples stop you from exploring. In fact, any object can dance, such as water, rocks, clothes, cars, particles, etc.
2024/7/8
Updated download file-1.3, add ColorMod node, modified AnimateDiff node, and added a reference image
2024/7/7
I created a flower collection that might be helpful to you.
I used AE to cut out the character dance and turn it into a black and white mask. If you need skills in this area, just ask ChatGPT. He will teach you how to use AE to turn a video into a black and white mask. This is what I did.
Tips below from:https://civarchive.com/models/372584/ipivs-morph-img2vid-animatediff-lcm-hyper-sd
❗If you are getting an error message CLIP Vision Model not found: /ComfyUI/models/clip_vision folder
CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors download and rename
CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors download and rename
❗If you are getting an error message IPAdapter model not found:
You are likely missing the IPAdapter model. In ComfyUI Manager Menu click Install Models - Search for ip-adapter_sd15_vit-G.safetensors and click Install.
If installing through Manager doesn't work for some reason you can download the model from Huggingface and drop it into \ComfyUI\models\ipadapter folder.
2024/7/6
Use QRCode Controlnet to control appearance and action, use IPAdapter to control the content and style of conversion.
Description
New interface layout, automatic edge detection and replacement
FAQ
Comments (23)
1.4 looks awesome.
You have to turn resize source on the last ImageCompositeMasked node or the cutout will be behind the outside lines
Are you a Magician?) ✨🧡
can we do Dog dance video using this workflow, please reply asap
do whatever you want
lora stacker error
I am getting an error like this. Does anyone know how to solve this problem?
https://www.reddit.com/r/comfyui/comments/1fhbetd/lora_stacker_error/
Replace it by the new one LoRa Staker, and it will work
@downpink thanks a lot
Hello, I generated the video is too messy, there will be grass roots, how to debug can remove the excess
What if I don't want this fat edges lines? why do i need 3 images? one for the subject, one for the background, and one for the lines? couldn't we just skip the lines? or just make them way too thinner?
Yes, you can reduce "float radius = 2 ", or you can bypass the glslnode
Thanks for this awesome workflow. I've tried this and get the accurate result. I tried to make this video ( https://www.youtube.com/watch?v=3JLDDX7AUcY ) with this workflow. But Failed. Could you please make a solution to us.
I have 32GB / 16 GB RAM/VRAM but it looks it's not enough. How much do you have ?
72GB RAM
Wow, any way to lower the requirements so I can use it in my rig ? Thanks
reduce the number of frames, or reduce the upscale size
Did it.
Had to disable upscaler altogether.
Oh, the right ipadapter preset is VIT-G
I love your work, thanks
很喜欢让植物在瓶子里面跳舞的氛围，怎么让东西在瓶子里面跳舞的呢，或者指定在某个空间里面跳舞呢？我怎么试不出来？求大佬指点一下，谢谢！！！
I really like the atmosphere of letting plants dance in bottles. How do you make things dance in bottles, or designate them to dance in a certain space? Why can't I try it out? Please give me some advice, thank you试试v1.3工作流，生成一张背景图片替换视频背景，让转绘的角色位置和容器相匹配
This is amazing , Thank you !
may i ask how to set background to green or solid color ?
Looks like I've figured it out. Thanks anyway))
@Alexandro43 what was the issue lmao
Would anyone be so kind to share the spidey LoRA with me? The model from the original 1.4 workflow appears to be 404'd :( Thanks!