Two trained LoRAs for LTX 2 T2V (official trainer, full weights no quants, 1.5mp dataset resolution):
LTX2_SS_Motion_7K / trained on 508 video clips
LTX2_SS_Details_30K / trained on 780 images
I was thinking of using a two-stage training approach like I do with Wan 2.2: → Motion LoRA for the first stage → Details LoRA for the second stage
Unfortunately the results were not as good as I had hoped, especially when using the distilled model.
I got better results with the non-distilled model when:
using a slightly higher step count (~12 steps)
using the distilled LoRAs at lower strength (~0.4) to avoid overcooked look.
I still don’t have any clear recipe for the perfect strength mixing, so I consider these models experimental for now. I decided to share them anyway, maybe I’ll retrain better versions later.
All example videos have the full workflow embedded, so feel free to download them and simply drag & drop into ComfyUI to check the exact settings used (prompts are generated from local files so you will only get the prompt from the previous run).
Don’t mind the stupid slop prompts lol, I just ran a batch and forgot about it.
I inject some money to train models on runpod but It wouldn't be possible without your help, so I appreciate those who used my refferal link, providing both of us free credits to use their service for longer sessions. You can also support me on buymeacoffee If you want to, it's appreciated. Thanks.
Description
FAQ
Comments (10)
You forgot to mention in the description WTF this is even. When I see "SSX," I expect snowboarding. That franchise really needs to make a comeback.
Maybe give a clue what the lora is for? Thanks for all your process details, but you forgot to describe the lora itself :D
Wish I could see the workflow to get the prompts, tried both "Save Video" and the Civit download button to no avail :(
Could you add a couple prompts to the examples?
For distilled models set Details to 0.2-0.4 max for first pass. For 2rd pass 0.7-0.9. For motion 0.5 and 0.3. Yeah and we can't control body. Small breasts, big, huge, flat chest doesn't work. Girls have same body type.
How do you use a diffuser in wan2gp? Can you just make a safetensor as well?
Is this for T2V?
do you have data for the male/female ratio in your training data? does it do PP well?
Guide from the LTX team on how to train your own lora, they specialized their own free training system: https://www.youtube.com/watch?v=sL-T6dsO0v4
Hey, just wanted to say thanks for your SS Loras, Been having fun adding them in various weights on LTX to add some thickness to the gens. ;)
Appreciated!
Please consider LTXV2.3 version?