Video2Vid

video2vid_v10.zip

v1.0

<h3 id="support-me-for-update-9xfudpzij"><a target="_blank" rel="ugc" href="https://ko-fi.com/downpink">Support me for update</a></h3>2025/2/8update v1.5, add word cloud transfer2024/9/22Rewrote the edge detection functionand removed the #include "lygia/space/ratio.glsl" line2024/9/4update v1.4, automatic edge detection and replacement2024/8/11update v1.3. add SDXL upscale and more stable replace bg2024/7/29<a target="_blank" rel="ugc" href="https://civarchive.com/models/608350">Simple Auto Mask For Videos </a>@SouthbayJa2024/7/14update v1.2. <a target="_blank" rel="ugc" href="https://www.youtube.com/watch?v=zV1qLYukTH8">Dance References</a>2024/7/12For new comfyUI users, check your input model, like Lora. checkpoint, controlnet, aniamtediff, and upscale model, and don't forget to update your comfyUI all. There is a screenshot of the node in the download file for reference.2024/7/9 Don’t let my reference examples stop you from exploring. In fact, any object can dance, such as water, rocks, clothes, cars, particles, etc.2024/7/8 Updated download file-1.3, add ColorMod node, modified AnimateDiff node, and added a reference image2024/7/7I created a <a target="_blank" rel="ugc" href="https://civarchive.com/collections/2788508">flower collection</a> that might be helpful to you. I used AE to cut out the character dance and turn it into a black and white mask. If you need skills in this area, just ask <a target="_blank" rel="ugc" href="https://chatgpt.com/">ChatGPT</a>. He will teach you how to use AE to turn a video into a black and white mask. This is what I did. Tips below from:<a target="_blank" rel="ugc" href="https://civarchive.com/models/372584/ipivs-morph-img2vid-animatediff-lcm-hyper-sd">https://civarchive.com/models/372584/ipivs-morph-img2vid-animatediff-lcm-hyper-sd</a>❗If you are getting an error message CLIP Vision Model not found: <code>/ComfyUI/models/clip_vision</code> folder<ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/h94/IP-Adapter/resolve/main/models/image_encoder/model.safetensors">CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors</a> download and rename</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/h94/IP-Adapter/resolve/main/sdxl_models/image_encoder/model.safetensors">CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors</a> download and rename</li></ul>❗If you are getting an error message IPAdapter model not found:You are likely missing the IPAdapter model. In ComfyUI Manager Menu click Install Models - Search for ip-adapter_sd15_vit-G.safetensors and click Install.If installing through Manager doesn't work for some reason you can download the model from <a target="_blank" rel="ugc" href="https://huggingface.co/h94/IP-Adapter/resolve/main/models/ip-adapter_sd15_vit-G.safetensors?download=true">Huggingface</a> and drop it into <code>\ComfyUI\models\ipadapter</code> folder.2024/7/6Use QRCode Controlnet to control appearance and action, use IPAdapter to control the content and style of conversion.

Files with SHA256: ecf8793370b15c03fddef0a3b596ca34890b43d37936208455b93f61320cb274