This is the conversion to GGUF of the SmoothMix Wan 2.2 v2 - https://civarchive.com/models/1995784/smooth-mix-wan-22-i2vt2v-14b
Files available also in https://huggingface.co/BigDannyPt/WAN-2.2-SmoothMix-GGUF
All were using umt5-xxl-encoder-Q8_0 GGUF and Wan 2.1 FP32 VAE and lightx2v_I2V_14B_480p_cfg_step_distill_rank128_bf16
Description
FAQ
Comments (35)
Do you have a workflow for this? where do use the lora?
not a lora, this is a diffusion model
The workflow was the normal template for Wan 2.2 I2V for the test videos (the ones that are the same in all quantize) and then I used SmoothMix I2V workflow.
As mentioned by dark, this isn't a lora, it is the gguf from a model
i am talking about this "lightx2v_I2V_14B_480p_cfg_step_distill_rank128_bf16"
I also would like to know how to use this 480p cfg step distill lora, as with the suggested workflow i keep getting this:
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.0.diff
lora key not loaded: diffusion_model.img_emb.proj.0.diff_b
lora key not loaded: diffusion_model.img_emb.proj.1.diff_b
lora key not loaded: diffusion_model.img_emb.proj.1.lora_down.weight
lora key not loaded: diffusion_model.img_emb.proj.1.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.3.diff_b
lora key not loaded: diffusion_model.img_emb.proj.3.lora_down.weight
lora key not loaded: diffusion_model.img_emb.proj.3.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.4.diff
lora key not loaded: diffusion_model.img_emb.proj.4.diff_b
@pigeon7717 ignore those missing keys, it is working since you still can generate with only 4 or 6 steps.
Just like it says in the original's model description, the strength is 3 in high and 1.5 low
@BigDannyPt could you please link the workflow here?
@NeuralKnit its this one https://civitai.com/models/1847730?modelVersionId=2264611
@BigDannyPt hey bro, whats the max step when i use lighting lora? 4? 6? 8? max steps for maximum quality available for using lighting loras?
@castielaensland189 I don't know, I normally go the other way around, the minimum steps. I used 6 steps in all workflows, I think that the quality was good
@BigDannyPt 6 is the right answer, you dont need more with Loras.
looks good. want to try. is this working in wan2gp?? adding this in the checkpoint folder does not work. is there a tutorial how to make this work in wan2gp??? any help would be appriciated
add these models to the diffusion model folder
@NeuralKnit thanx for the help. but i put it in the "../models" folder this does not work, than i put it in the "../models/wan" folder also not working. i am new with this. there is no "diffusion model" folder. what am i doing wrong
I don't have an Nvidia card, so I don't know how to use wan2gp
if u r using comfyui or forge u should have "diffusion_models" folder. or create one. the use a unet or diffusion loader node in comfyui to load the model. you cannot use normal checkpoint loader to load these models
@NeuralKnit okay, wan2gp is beginners level, easy to understand, except when you want to try a custom checkpoint, comfyUI looks like you have to be an expert with all the nodes stuff, guess i have to learn the comyfUI, thank you....
1: Wan2GP doesn't support GGUF Quantized format. Only Safetensors.
2: It can load checkpoints, but not perfectly. You need a finetunes file for it.
Is this the latest 2.0? Is this not open yet? Is the quantitative version of GGUF open?
This is for the latest v2.0 as the title says.
The full model is not yet open unless you pay 250 yellow buzz.
GGUF is open since it will always have so type of impact on the quality.
I know this is probably a rare request, but can you also do a Q2K version? I use Q2K for my first sampler in a 3 sampler precision gating setup for my videos and I would be really interested to see how this model behaves in that role.
Just added, but the quality has a big impact
Not a rare req, idk what's the workflow...
@BigDannyPt ...but it should be useful to try High Q2 and Low with Q3 or higher not to lose much quality, Q2 is not worthless
@BigDannyPt yes, I will be writing an article about it soon, but the good thing about Q2K is that at high noise you dont need precision, and having too much precision actually gives the model too many options and too much freedom at the highest noise part of the process. So progressing from Q2K at the highest noise to something like Q5K_S at mid noise and then reserving the highest precision for low noise puts the precision where you actually want it. Basically all of my videos have Q2K versions at high noise for roughly two steps.
Ok... so i'm a big fan of SmoothMix v1, i did thousand of videos, but for some rare reason, this Q8 model is not giving me nsfw movements, it simply does nothing, the characters moves weird, idk what's happening, already tried the recommended WF and my own wf too, tested lot of variants, samplers and combinations, but still being needed to use nsfw loras to make it work... someone else had the same problem? is this model much less nsfw?
from the results that I have, only when is sex related, it starts to freak out, the rest seems to be working correctly
@BigDannyPt should i add additional lora to get something like sex? but the gallery shows seems like they are not use lora. Do I miss something? Because v1 gguf works for me but switch to v2 gguf scene nearly not move.
@moyui not sure, I didn't used any lora besides the speedup. try to ask an LLM to enhance the prompt, sometimes is the prompt that has too low details and it doesn't capture the motion
You mention that you use the lightning lora, but whenever I use it I get very messed up video, and when I don't use it at all I get good results. Are the lighting loras already embedded in the gguf?
No, I've converted the model directly.
which one are you using and what are the strength used?
lightx2v_I2V_14B_480p_cfg_step_distill_rank128_bf16 like you referred to, and I tried strength 3 and 1.5 as suggested by DigitalPastel, I'm using his workflow v2 gguf workflow
gguf qtypes: F16 (694), Q8_0 (400), F32 (1)
model weight dtype torch.float16, manual cast: None
model_type FLOW
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.0.diff
lora key not loaded: diffusion_model.img_emb.proj.0.diff_b
lora key not loaded: diffusion_model.img_emb.proj.1.diff_b
lora key not loaded: diffusion_model.img_emb.proj.1.lora_down.weight
lora key not loaded: diffusion_model.img_emb.proj.1.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.3.diff_b
lora key not loaded: diffusion_model.img_emb.proj.3.lora_down.weight
lora key not loaded: diffusion_model.img_emb.proj.3.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.4.diff
lora key not loaded: diffusion_model.img_emb.proj.4.diff_b
Requested to load WAN21
loaded completely; 14825.47 MB loaded, full load: True
Whether using the native LoRA loader (model only) or HIGH LORA LOADER, the above information appears. The resulting video has very weak motion dynamics, much weaker than the official Wan2.2 version, and significantly different from what SmoothMIX describes. What could be the problem?
this isn't the official wan2.2 version, this is a gguf from a model with a lot of things merged, there will always be difference.
you can try with the non gguf version and see if you have the sam result ( from my tests, it was the same or very close)
the lora, if you can generate the video with 4 or 6 steps and with good quality, it is working
@BigDannyPt Smoothmix is FP8, and I'm using the Mac version, so I can't run the original Smoothmix and therefore can't compare it to the GGUF version. I tested the 1030 and 1022 versions of LoRA and found that the performance has improved.
@Jarhead5952 Seems that this is an fp8 base quantization, so, it will not work well in Mac, Mac need a higher precision base at least fp16, stick to nsfw_remix, it gives pretty good results