<h1 id="base-on-framepack-exeivbmx0">base on framepack</h1><h2 id="the-1.5-version-trained-exclusively-on-a-single-video-exhibits-improved-motion-dynamics-and-more-coherent-action-sequences-compared-to-version-1.0.-however-this-approach-has-led-to-overfitting-in-certain-areas-such-as-unnatural-limb-proportions-which-i-am-currently-addressing.-for-optimal-results-i-suggest-generating-content-with-a-duration-of-7.5-seconds-and-a-resolution-of-448x752.you-can-use-cowboy-shothands-on-hips-to-generate-first-img-fmsly1qxs"><span style="color:rgb(34, 139, 230)">The 1.5 version, trained exclusively on a single video, exhibits improved motion dynamics and more coherent action sequences compared to version 1.0. However, this approach has led to overfitting in certain areas, such as unnatural limb proportions, which I am currently addressing. For optimal results, I suggest generating content with a duration of 7.5 seconds and a resolution of 448x752.</span><br /><span style="color:#40c057">you can use </span><span style="color:#fa5252">cowboy shot,hands on hips</span><span style="color:#40c057"> to generate first img</span></h2><p></p><hr /><p></p><h1 id="v1.0-awceyhzh8">v1.0</h1><p><span style="color:rgb(250, 82, 82)">The FramePack LoRA training conducted using the Musubi tuner utilized 13 videos for the generation of big swing dance.</span></p><h1 id="you-can-download-this-videothen-drag-into-comfyui-to-see-the-workflow-and-parameter-h9qeoabq2">you can download this video,then drag into comfyui to see the workflow and parameter</h1><p><span style="color:rgb(230, 73, 128)">The training took approximately 24 hours on 4090. I would highly recommend using a GPU with greater than 24GB of VRAM for training.</span></p><p><strong><span style="color:rgb(190, 75, 219)">I have only tested this on BF16 precision and have not conducted any evaluations under FP8 precision.</span></strong></p><p><span style="color:rgb(121, 80, 242)">thanks to 青龙圣者 , for addressing some questions regarding training parameters.</span></p><h3 id="it-can-be-observed-that-framepack-even-without-using-f1-achieves-a-remarkably-significant-improvement-in-motion-amplitude-when-employing-lora.-v7q6d7xnr"><span style="color:rgb(76, 110, 245)">It can be observed that FramePack, even without using F1, achieves a remarkably significant improvement in motion amplitude when employing LoRA.</span></h3><p><span style="color:rgb(34, 139, 230)">So I’m wondering if a single LoRA could simply amplify all motion amplitudes significantly</span><span style="color:rgb(0, 102, 255)">.</span></p><p><span style="color:rgb(21, 170, 191)">On the RTX 4080 32GB, it takes an average of 1 minute per second to generate.</span></p>

Files with SHA256: d2478d091203d914d0411dfbacbf945f3d6b66dfe0dfa605ea41056879744579