"This is an early v0.1 release with known limitations. It transfers simpler styles (e.g. flat 2D / cel-shaded / monochrome line art), but struggles with more complex styles that involve texture, intricate detail, or strong material/lighting effects.Quality often improves noticeably if you:<ul><li>raise CFG to ~1.1 – 2.0 (CFG=1 is the distilled-model default)</li><li>use a non-distilled LTX-2.3 model</li></ul>If I have enough compute, I'll keep working on a better version. Till then, enjoy and happy creating!An IC-LoRA (in-context LoRA) for LTX-Video 2.3 (22B) trained for image-guided style transfer: given a source video and a single reference image describing the target style, the model re-renders the video in that style while preserving the original content and motion.<h2 id="training-details">Training details</h2>This IC-LoRA was trained on <a target="_blank" rel="ugc" href="https://runpod.io/?ref=vpp0cion">RunPod cloud GPUs</a>.<ul><li>Base model: Lightricks/LTX-2.3 (22B)</li><li>Training framework: <a target="_blank" rel="ugc" href="https://github.com/Lightricks/LTX-2">ltx-trainer</a> (Lightricks)</li><li>Training strategy: video-to-video IC-LoRA (<code>first_frame_conditioning_p: 0.0</code>, reference latents stream carries style)</li><li>Released checkpoint: step 8,000</li><li>LoRA rank / alpha: 128 / 128</li><li>Target modules: <code>attn1.{to_k,to_q,to_v,to_out.0}</code> + <code>attn2.{to_k,to_q,to_v,to_out.0}</code> (self + cross attention)</li><li>Optimizer: Prodigy</li><li>Scheduler: constant</li><li>Mixed precision: bf16</li><li>Batch size: 1 (gradient checkpointing on)</li><li>Timestep sampling: <code>shifted_logit_normal</code></li><li>Resolution: trained at 768x448 @ 97 frames</li><li>Dataset: 562 cross-pair samples derived from the Ditto-1M style-transfer dataset (50 styles × ~11 pairs each). Each training reference is constructed by replacing frame 0 of the source video with the stylized first frame of a different pair from the same style</li></ul><h2 id="inference">Inference</h2>For inference I used ComfyUI. Workflow available here: <a target="_blank" rel="ugc" href="https://huggingface.co/datasets/Cseti/ComfyUI-Workflows/blob/main/ltx/2.3/restyle-ic-lora/README.md">Cseti/ComfyUI-Workflows — restyle-ic-lora</a>.Conditioning — both modalities supported, mixing them works best:<ul><li>Image reference: a single still image in the requested style, fed as frame 0</li><li>Text prompt: e.g. <code>Make it Disney 2D Animation style.</code> / <code>Make it watercolor style.</code> — matches the training caption template (<code>Make it {style} style.</code>).</li></ul>Strength: 1.0.<h2 id="prompting-tips">Prompting tips</h2>The style reference image carries the primary signal; the text prompt reinforces and disambiguates it. A few patterns that help:<ul><li>Match the training caption template: <code>Make it {style} style.</code> — e.g. <code>Make it watercolor style.</code>, <code>Make it Disney 2D Animation style.</code>. The shorter form is the safe default.</li><li>A more detailed style description can help: Expanding the prompt with technique / medium / palette / lighting cues helps the model toward your intent.</li></ul><h2 id="important-notes">Important Notes</h2>This LoRA is created as part of a research project. The training data is derived from the publicly released Ditto-1M dataset; please respect the licensing terms of the source dataset and any source video content. Users utilize the model at their own risk and are obligated to comply with applicable copyright laws.<h2 id="acknowledgement">Acknowledgement</h2>Special thanks to:<ul><li><a target="_blank" rel="ugc" href="https://github.com/Lightricks">Lightricks</a> for open-sourcing the LTX-2 trainer and the LTX-2.3 22B model</li><li>The authors of Ditto-1M for releasing the style-transfer dataset that made this LoRA possible</li></ul><h2 id="support">Support</h2>Training models like this requires renting cloud GPUs, which gets expensive quickly. If you find this LoRA useful and would like me to keep contributing open-source models, your support is very much appreciated:<a target="_blank" rel="ugc" href="https://ko-fi.com/chetyart"><img src="https://img.shields.io/badge/Ko--fi-Support-FF5E5B?style=for-the-badge&amp;logo=ko-fi&amp;logoColor=white" alt="Ko-fi" /></a> <a target="_blank" rel="ugc" href="https://liberapay.com/chetyart/donate"><img src="https://img.shields.io/badge/Liberapay-Donate-F6C915?style=for-the-badge&amp;logo=liberapay&amp;logoColor=black" alt="Liberapay" /></a>

Files with SHA256: 22861dd2d740f9a0bc430ea262f5d37114ed2727be529c6d80bb66f3bd5a2e74