LoRa Diffusers format may not be supported by ComfyUI! (At least I couldn't run it)
Trying to train LoRa with https://github.com/a-r-r-o-w/finetrainers
The following keywords are used in the prompt:
breast growth, woman with growing breasts.
Example of a prompt:
breast growth, Anime-style digital animation of a cute, busty woman with growing breasts and short brown hair, green eyes, and large wings. She wears a frilly white and pink dress with a star pendant, holding a wand. Background is pastel pink with sparkles.Code to run LoRa (example taken from finetrainers)
import torch
from diffusers import HunyuanVideoPipeline
import torch
from diffusers import HunyuanVideoPipeline, HunyuanVideoTransformer3DModel
from diffusers.utils import export_to_video
model_id = "hunyuanvideo-community/HunyuanVideo"
transformer = HunyuanVideoTransformer3DModel.from_pretrained(
model_id, subfolder="transformer", torch_dtype=torch.bfloat16
)
pipe = HunyuanVideoPipeline.from_pretrained(model_id, transformer=transformer, torch_dtype=torch.float16)
pipe.load_lora_weights("my-awesome-name/my-awesome-lora", adapter_name="hunyuanvideo-lora")
pipe.set_adapters(["hunyuanvideo-lora"], [0.6])
pipe.vae.enable_tiling()
pipe.to("cuda")
output = pipe(
prompt="A cat walks on the grass, realistic",
height=320,
width=512,
num_frames=61,
num_inference_steps=30,
).frames[0]
export_to_video(output, "output.mp4", fps=15)The training was conducted on 220 videos 33x512x512 (33 frames and 512x512 video resolution)
Most of the videos were generated by AI and only 27 videos were made using Framer interpolation