Wan 2.2!

Re-trained the dataset on Wan 2.2, make sure to grab BOTH Loras (High and Low)!
Getting great results with K3NK's workflow - https://civarchive.com/models/1824027/wan-22-t2v-i2v4-stepskijais-wrapper-workflowk3nk


Update 6.17

I realized while trying to improve this LoRA that I never uploaded a T2V version, so... here it is. Enjoy!

-- -- --

My second LoRA... I've made some drastic changes to my captioning approach, and the results show some nice improvement.

Please share anything you make with this, I'd love to see some better prompts!

This was trained on WAN 14B I2V, on 45 videos normalized to 480P / 24FPS and trimmed to 3 seconds using diffusion-pipe. However, it works okay with the T2V model, and I've included some examples from that.

My captioning approach:

1. 45 videos, resized to 480P, 3 seconds, 24FPS.

2. Ran each one through ComfyUI_Qwen2-VL-Instruct to generate a base video description, but this unfortunately doesn't pick up on any NSFW bits. This usually took a few tries on the same image, since the LLM almost seemed "disgusted" by the suggestion. :D

3. Grabbed my "favorite" frame and ran that through Joy Caption 2, then I manually combined the Qwen description and the Joy Caption Two caption to make the final .txt file.