Support me for update
2025/2/8
update v1.5, add word cloud transfer
2024/9/22
Rewrote the edge detection function
and removed the #include "lygia/space/ratio.glsl" line
2024/9/4
update v1.4, automatic edge detection and replacement
2024/8/11
update v1.3. add SDXL upscale and more stable replace bg
2024/7/29
Simple Auto Mask For Videos @SouthbayJa
2024/7/14
update v1.2. Dance References
2024/7/12
For new comfyUI users, check your input model, like Lora. checkpoint, controlnet, aniamtediff, and upscale model, and don't forget to update your comfyUI all. There is a screenshot of the node in the download file for reference.
2024/7/9
Don’t let my reference examples stop you from exploring. In fact, any object can dance, such as water, rocks, clothes, cars, particles, etc.
2024/7/8
Updated download file-1.3, add ColorMod node, modified AnimateDiff node, and added a reference image
2024/7/7
I created a flower collection that might be helpful to you.
I used AE to cut out the character dance and turn it into a black and white mask. If you need skills in this area, just ask ChatGPT. He will teach you how to use AE to turn a video into a black and white mask. This is what I did.
Tips below from:https://civarchive.com/models/372584/ipivs-morph-img2vid-animatediff-lcm-hyper-sd
❗If you are getting an error message CLIP Vision Model not found: /ComfyUI/models/clip_vision folder
CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors download and rename
CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors download and rename
❗If you are getting an error message IPAdapter model not found:
You are likely missing the IPAdapter model. In ComfyUI Manager Menu click Install Models - Search for ip-adapter_sd15_vit-G.safetensors and click Install.
If installing through Manager doesn't work for some reason you can download the model from Huggingface and drop it into \ComfyUI\models\ipadapter folder.
2024/7/6
Use QRCode Controlnet to control appearance and action, use IPAdapter to control the content and style of conversion.
Description
FAQ
Comments (120)
My video has only one leg lift no matter how many seconds it outputs. Why is that?
if you install qrcode and lineart controlnet model?
@downpink All models have been installed and my comfyui is the latest version. The Empty Latent Image node: batch size cannot be connected to the Load Video(upload) node: frame_count. Is this the reason?
@downpink Thank you. I know what to do, okay
I really can't find the download link for this dynamic Lora "aidma RUN Motion Lora" file. Could the versatile author and other colleagues provide a download link? Thank you very much。(我实在是找不到这个动态Lora“aidma-RUN-Motion Lora”文件的下载地址了,万能的作者与其他小伙伴能不能给提供个下载链接,在此不胜感激。)
First of all, thanks a lot!! I'd like to ask a question, in your dance example video, is it only a black and white converted video or an actual depth map?
not depth map, just white and black mask vid
Collection of model download addresses
(模型下载地址集合)
dreamshaper_8LCM.safetensors
https://civitai.com/models/4384?modelVersionId=252914
control_v1p_sd15_qrcode_monster.safetensors
https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster/tree/main
Ghibli_v6 Lora.safetensors
https://civitai.com/models/54233/ghiblibackground
AnimateLCM_sd15_t2v.ckpt
https://huggingface.co/wangfuyun/AnimateLCM/tree/main
aidma-RUN-Motion Lora.safetensors
https://civitai.com/models/476267/run-motion-lora-for-animatediff
add_detail.safetensors
tks
Does it work on XL models?
Not supported yet
Nice workflow mate!!
Btw while running the same, hitting the below issue
Error occurred when executing IPAdapterUnifiedLoader: IPAdapter model not found.
As per the instruction, have downloaded ip-adapter_sd15_vit-G.safetensors and stored it under models/ipadapter... Still hitting the issue
download: ip-adapter-plus_sd15.bin,and update your ipadapter
Thanks.... IPAdapter issue has been resolved, but hitting a new issue now !!
Expected query, key, and value to have the same dtype, but got query.dtype: float key.dtype: struct c10::Half and value.dtype: struct c10::Half instead.
Any idea howto resolve it bro ?? I'm a total newbie here 😌
Hey, my man) Sometimes the result is trying to be like a human like - face, legs. How to remove this and replace so that the result will consist only of reference image details.
Your prompt words should not have characteristics about people,reduce the strength of lineart controlnet
Hi, i also recive this error ; Error occurred when executing KSampler (Efficient): Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui\efficiency_nodes.py", line 713, in sample samples, images, gifs, preview = process_latent_image(model, seed, steps, cfg, sampler_name, scheduler, File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui\efficiency_nodes.py", line 533, in process_latent_image samples = KSampler().sample(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1344, in sample return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1314, in common_ksampler samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 383, in motion_sample latents = orig_comfy_sample(model, noise, args, *kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control_reference.py", line 47, in refcn_sample return orig_comfy_sample(model, args, *kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\sample.py", line 37, in sample samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 755, in sample return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 657, in sample return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 644, in sample output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 623, in inner_sample samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 534, in sample samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\k_diffusion\sampling.py", line 745, in sample_lcm denoised = model(x, sigmas[i] s_in, *extra_args) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 272, in call out = self.inner_model(x, sigma, model_options=model_options, seed=seed) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 610, in call return self.predict_noise(*args, kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 613, in predict_noise return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 428, in evolved_sampling_function cond_pred, uncond_pred = sliding_calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 572, in sliding_calc_cond_uncond_batch sub_cond_out, sub_uncond_out = comfy.samplers.calc_cond_batch(model, [sub_cond, sub_uncond], sub_x, sub_timestep, model_options) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 218, in calc_cond_batch output = model.apply_model(input_x, timestep_, c).chunk(batch_chunks) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 97, in apply_model model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float() File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1518, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1527, in callimpl return forward_call(*args, kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\SeargeSDXL\modules\custom_sdxl_ksampler.py", line 71, in new_unet_forward x0 = old_unet_forward(self, x, timesteps, context, y, control, transformer_options, kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\diffusionmodules\openaimodel.py", line 850, in forward h = forward_timestep_embed(module, h, emb, context, transformer_options, time_context=time_context, num_video_frames=num_video_frames, image_only_indicator=image_only_indicator) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 101, in forward_timestep_embed x = layer(x, context) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1518, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1527, in callimpl return forward_call(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\motion_module_ad.py", line 673, in forward return self.temporal_transformer(input_tensor, encoder_hidden_states, attention_mask, self.view_options, mm_kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1518, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1527, in callimpl return forward_call(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\motion_module_ad.py", line 891, in forward hidden_states = block( File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1518, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1527, in callimpl return forward_call(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\motion_module_ad.py", line 1002, in forward attention_block( File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1518, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1527, in callimpl return forward_call(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\motion_module_ad.py", line 1185, in forward hidden_states = self.pos_encoder(hidden_states).to(hidden_states.dtype) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1518, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1527, in callimpl return forward_call(*args, **kwargs) File "D:\comfyui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\motion_module_ad.py", line 1112, in forward x = x + self.pe[:, : x.size(1)]
Hm, it is working so far.
I switched out the source material and changed a bit about the preprocessing, but the rest is the same.
I am getting faces on dancers, maybe because of the lineart preprocessor?
Any idea how to change that?
The model in the process is fully used, but an error occurs:
Error occurred when executing ADE_ApplyAnimateDiffModelSimple: 'MotionModelPatcher' object has no attribute 'model_keys' File "D:\AI\ComfyUI-aki-v1\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\AI\ComfyUI-aki-v1\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\AI\ComfyUI-aki-v1\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\AI\ComfyUI-aki-v1\custom_nodes\ComfyUI-AnimateLCM\animatediff\nodes_gen2.py", line 146, in apply_motion_model return ApplyAnimateDiffModelNode.apply_motion_model(self, motion_model, motion_lora=motion_lora, File "D:\AI\ComfyUI-aki-v1\custom_nodes\ComfyUI-AnimateLCM\animatediff\nodes_gen2.py", line 104, in apply_motion_model motion_model = motion_model.clone() File "D:\AI\ComfyUI-aki-v1\custom_nodes\ComfyUI-AnimateLCM\animatediff\model_injection.py", line 216, in clone n.model_keys = self.model_keys
check the Load Animatediff LoRA node, if you have the RUN-Motion Lora in your folder
@downpink Yes, loading the RUN-Motion model still displays this error
@alexby ok, have you update comfyui and custom_node
@downpink Yes, it has been updated
@alexby dm me
@downpink This should be a problem with Animatediff, maybe I need to reinstall it
@alexbysure
Atill getting this error. Any help? thank you
https://www.dropbox.com/scl/fi/gcn5yfmoxm4227npfja2o/scrnli_17-7-2024-13-26-33.png?rlkey=yupg41ujf2segqw4vozvdihgt&dl=0
Hello! the following error occurs during the Efficient Loader run. In CMD, it looks like this
Please help me understand what the problem is
check your input model, like checkpoint and lora
@downpink I checked this first, downloaded and selected exactly those models, then once again walked through the screenshot, opened all the paths with arrows and made sure that I have them.
Maybe you can try select Lora with None for testing
@downpink Everything works, the problem was in installing the wrong version of efficient nodes. As soon as I downloaded the updated one, everything started working! Sorry for bothering you, the workflow is great!
HI, I'm getting error:
Error occurred when executing VHS_LoadVideo: module 'cv2' has no attribute 'VideoCapture'
Any idea?
maybe you can update your custom_node, or re-install OpenCV package in your python
Hi! Can you help me with the error?
Efficient Loader
TypeError: type str doesn't define round method
I added all new Efficient nodes from here https://github.com/jags111/efficiency-nodes-comfyui
but errors is the same. I'm newbie in python
Double-check all inputs connected to the Efficient Loader, especially those that are supposed to be numeric (weights, strengths, etc.).
Make sure these inputs are the correct numeric type and not strings.
@downpink aaaah thank you!! I found and it works
Maybe you can recommend you favorite Lora for this workflow?)
Error occurred when executing ControlNetLoaderAdvanced: 'NoneType' object has no attribute 'lower' File "D:\ComfyUI-aki\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\ComfyUI-aki\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\ComfyUI-aki\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\ComfyUI-aki\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\nodes.py", line 90, in load_controlnet controlnet = load_controlnet(controlnet_path, timestep_keyframe) File "D:\ComfyUI-aki\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 513, in load_controlnet controlnet_data = comfy.utils.load_torch_file(ckpt_path, safe_load=True) File "D:\ComfyUI-aki\comfy\utils.py", line 14, in load_torch_file if ckpt.lower().endswith(".safetensors"):
Hello, Can you help me with the error? thanks
check your controlnet model version, it should be SD1.5
谢谢,按照您说的升级后可以了,我4060 8g显存 在放大那一步爆显存了,这个最低显存是要多少的,有没有办法让8g显存也能制作这个跳舞视频呢?
Can you tell me how to choose the main photo and how to write prompt words? Why is the result I made very poor, without any artistic beauty.
no, I can't
@downpink Please, please, please
@1216445325732 what's your result? too blurry?
@downpink My output result shows that the fusion of the subject and background is too strong to highlight the subject. And I used pebbles as the theme and your beach picture as the background, creating an effect where all the stones are in the water and the lower body cannot be seen.
我想做任意素材拼接成的人物视频,思路是不是应该先在PS或其他软件中,先把主体人物拼接出来呀。就像你那个蜘蛛人视频里的那种完美效果一样。
I want to create a character video that combines any material. Shouldn't the idea be to first splice the main characters in PS or other software. Just like the perfect effect in your Spider Man video.
@1216445325732 ok, maybe you can add depth contorlnet which can make your background and subject more separate, but the strength of depth should under 0.5.
@downpink Okay, okay, I'll try again. Thank you very much
I finally know where my problem lies, it turns out that my 'lineart' model was loaded incorrectly. Thank you for your positive response. Excuse me
@1216445325732 Hello. What was the error of the 'lineart' model?
Hello! Your workflow is perfect and it excites me.
However, I am experiencing some issues with my setup and encountering similar problems. When I compare my settings with the images provided upon downloading the workflow, everything appears to be the same.
I had an issue with CLIP Vision as well, so I followed the instructions and downloaded and renamed the two necessary files. Additionally, since there was no ipadapter directory, I created one and placed the ip-adapter_sd15_vit-G.safetensors file in it.
I am also using the qrcode:
control_v1p_sd15_qrcode_monster.ckpt
Are there any other potential issues that might be causing the problem? The processing completes successfully, but the generated dance is missing one leg.
do you have lineart controlnet? add depth controlnet may also help
@downpink Thank you for your quick response. As you pointed out, it seemed that I was missing the lineart controlnet. I realize I need to understand the roles of each node better.
I will experiment with various patterns. Thank you very much.
Brothers, it's best for everyone to be more careful. It's best to use all the models recommended by the author when starting with this workflow, otherwise it's easy to make mistakes. The best choice is to gradually modify it after getting familiar with it.
Error occurred when executing ImageUpscaleWithModel: [enforce fail at C:\Users\vfirs\projects\ipex-standalone\pytorch\c10\core\impl\alloc_cpu.cpp:72] data. DefaultCPUAllocator: not enough memory: you tried to allocate 24190451712 bytes. File "D:\Arc-AIDraw2\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\Arc-AIDraw2\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\Arc-AIDraw2\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\Arc-AIDraw2\ComfyUI\comfy_extras\nodes_upscale_model.py", line 57, in upscale s = comfy.utils.tiled_scale(in_img, lambda a: upscale_model(a), tile_x=tile, tile_y=tile, overlap=overlap, upscale_amount=upscale_model.scale, pbar=pbar) File "D:\Arc-AIDraw2\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "D:\Arc-AIDraw2\ComfyUI\comfy\utils.py", line 429, in tiled_scale output = torch.empty((samples.shape[0], out_channels, round(samples.shape[2] upscale_amount), round(samples.shape[3] upscale_amount)), device=output_device)
You don't have enough system memory to upscale the video in upscale model(using model) node. You can build a separate node to enlarge it without loading other models.
When I tried to make something different instead of flower, First second which is 15 frame is good but when I extend somehow human character pieces coming into the video. Anyone has same problem and know how to fix ?
How to solve the following error?
Error occurred when executing KSampler (Efficient):
0
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\efficiency-nodes-comfyui\efficiency_nodes.py", line 732, in sample
samples, images, gifs, preview = process_latent_image(model, seed, steps, cfg, sampler_name, scheduler,
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\efficiency-nodes-comfyui\efficiency_nodes.py", line 550, in process_latent_image
samples = KSampler().sample(model, seed, steps, cfg, sampler_name, scheduler, positive, negative,
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\nodes.py", line 1373, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\nodes.py", line 1343, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 9, in informative_sample
return original_sample(*args, **kwargs) # This code helps interpret error messages that occur within exceptions but does not have any impact on other operations.
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 522, in motion_sample
latents = orig_comfy_sample(model, noise, args, *kwargs)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\sample.py", line 43, in sample
samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 829, in sample
return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 729, in sample
return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 716, in sample
output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 695, in inner_sample
samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 600, in sample
samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\python_embeded\Lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\k_diffusion\sampling.py", line 779, in sample_lcm
denoised = model(x, sigmas[i] s_in, *extra_args)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 299, in call
out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 682, in call
return self.predict_noise(*args, **kwargs)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 685, in predict_noise
return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 625, in evolved_sampling_function
cond_pred, uncond_pred = sliding_calc_conds_batch(model, [cond, uncond_], x, timestep, model_options)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 815, in sliding_calc_conds_batch
sub_conds_out = calc_cond_uncond_batch_wrapper(model, sub_conds, sub_x, sub_timestep, model_options)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 899, in calc_cond_uncond_batch_wrapper
return comfy.samplers.calc_cond_batch(model, conds, x_in, timestep, model_options)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\comfy\samplers.py", line 202, in calc_cond_batch
c['control'] = control.get_control(input_x, timestep_, c, len(cond_or_uncond))
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\utils.py", line 468, in get_control_inject
return self.get_control_advanced(x_noisy, t, cond, batched_number)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 32, in get_control_advanced
return self.sliding_get_control(x_noisy, t, cond, batched_number)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 79, in sliding_get_control
return self.control_merge(None, control, control_prev, output_dtype)
File "G:\ComfyUI_Mie_V2.0-20240612\ComfyUI_Mie_V2.0\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\utils.py", line 575, in control_merge_inject
x = control_output[i]
ths!!!
I have the same error and cant find the way to fix it... I have even recreate de Ksampler efficient and does not work... Any one have a thought?...
When loading the graph, the following node types were not found:
RIFE VFI
Nodes that have failed to load will show as red on the graph.
install missing custom nodes in you comfyUI manager
This workflow is so fun. Thank you! Does anyone have any suggestions on upscaling 200ish frames on 16gb VRAM? I get VRAM errors on even 100 when upscaling.
https://photos.app.goo.gl/oPraEt4p9dwuvK1Y7
I don't understand what I should do😭
Error occurred when executing Efficient Loader: 'NoneType' object has no attribute 'lower' File "C:\ComfyUI\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui\efficiency_nodes.py", line 158, in efficientloader model, clip = load_lora(lora_params, ckpt_name, my_unique_id, cache=lora_cache, ckpt_cache=ckpt_cache, cache_overwrite=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui\tsc_utils.py", line 372, in load_lora lora_model, lora_clip = recursive_load_lora(lora_params, ckpt, clip, id, ckpt_cache, cache_overwrite, folder_paths) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui\tsc_utils.py", line 366, in recursive_load_lora return recursive_load_lora(lora_params[1:], lora_model, lora_clip, id, ckpt_cache, cache_overwrite, folder_paths) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui\tsc_utils.py", line 363, in recursive_load_lora lora_model, lora_clip = comfy.sd.load_lora_for_models(ckpt, clip, comfy.utils.load_torch_file(lora_path), strength_model, strength_clip) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\comfy\utils.py", line 14, in load_torch_file if ckpt.lower().endswith(".safetensors"): ^^^^^^^^^^
check if you have Lora in your folder
@downpink yes, she is there
@downpink Moreover, I tried it with the lore turned off, the error remains, the process does not go further than this node
switch you vae to Baked VAE
@downpink didn't work, I tried everything there is https://photos.app.goo.gl/RL9muBjFLcq3CY2k6
@downpink Perhaps you are right and the problem is in the lore, please specify which folder it should be in, I have models and lore pulled up from Automation 1111, there are a lot of folders with processes in Comfy, I’m completely confused
@madamisteri4ka780 \ComfyUI\models\loras
Why is mine blurry?
you should use LCM vision moedel
thank you。But the shape is not like the body, what should be done with it?
@huilongning867 make sure your lineart controlnet working
@downpink thank you very much. How to make white and black mask vid?
@AuroraNing here's the process of separating the video into a B&W version https://civitai.com/models/608350/simple-auto-mask-for-videos-rotoscope-video-masking
为什么我的出来的是蒙版图
s生成出来的视频是没有背景的吗
如何控制背景图尽量变化不要太大呢
请问一下,我这里背景都是偏黑偏暗的,拿工作流里的图和参数试了下出来也是黑的,不知道哪里出了问题?
https://drive.google.com/file/d/1Uybj3Z4ugRYMfa1g-dfDUVN_ZlFMFcXZ/view?usp=sharing
这套工作流可以局部动画吗,比如一个盘子里有一个辣椒跳舞,除了辣椒外其他地方基本不变
something wrong with my realistic lineart node.What model should I download and Where to put it?
It tell me this
Prompt executed in 0.01 seconds
got prompt
!!! Exception during processing!!! LineartDetector.from_pretrained() missing 1 required positional argument: 'pretrained_model_or_path'
Traceback (most recent call last):
File "D:\ComfyUI-aki-v1.1\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\ComfyUI-aki-v1.1\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\ComfyUI-aki-v1.1\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\ComfyUI-aki-v1.1\custom_nodes\comfyui_controlnet_aux\node_wrappers\lineart.py", line 19, in execute
model = LineartDetector.from_pretrained().to(model_management.get_torch_device())
TypeError: LineartDetector.from_pretrained() missing 1 required positional argument: 'pretrained_model_or_path'
Error occurred when executing IPAdapterUnifiedLoader: IPAdapter model not found. File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 543, in load_models raise Exception("IPAdapter model not found.")
I am getting an error even though the file is in the correct location. Can you help? :/
https://drive.google.com/file/d/1h1xHPm30mMJkivTpnyqp5ygtbGTl51X5/view?usp=sharing
Try download ip-adapter-plus_sd15 model from your manager
Hey, great workflow. How did you turn the dance reference video into the black and white video please?
use AE
@sejaldatta84 I have a super basic mask workflow that made to use with @downpink's workflow. You just add the video you want to mask and hit the Queue button. I'll load it to my profile shortly.
@SouthbayJay awesome, that would be great! Thank you!
这是??
In the image of the workflow with red arrows, we can't see what do you use in the second control net on the bottom, the green one below the "qr monster", what do you suggest?
The one getting the line art ? control_v11p_sd15_lineart_fp16.safetensor I think
@helmernicolas278 thanks, I saw after the node description and used lineart :) but i continue to get blurried images, even though I put everything he put in :(
Error occurred when executing Efficient Loader:
'NoneType' object has no attribute 'lower'
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui\efficiency_nodes.py", line 158, in efficientloader
model, clip = load_lora(lora_params, ckpt_name, my_unique_id, cache=lora_cache, ckpt_cache=ckpt_cache, cache_overwrite=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui\tsc_utils.py", line 370, in load_lora
ckpt, clip, = loadcheckpoint(ckpt_name, id, cache=ckpt_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui\tsc_utils.py", line 246, in load_checkpoint
out = comfy.sd.load_checkpoint_guess_config(ckpt_path, output_vae, output_clip=True, embedding_directory=folder_paths.get_folder_paths("embeddings"))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\comfy\sd.py", line 491, in load_checkpoint_guess_config
sd = comfy.utils.load_torch_file(ckpt_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "J:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 14, in load_torch_file
if ckpt.lower().endswith(".safetensors"):
^^^^^^^^^^
Help me solve this error
Same problem here
Same
Maybe I ask an obvious question for some but, why did you used the control_v1p_sd15_qrcode_monster? what does it do specifically?
I think it's controlled by black and white mask